Apr 14 04:10:06 user devstack@n-api.service[61594]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Apr 14 04:10:06 user devstack@n-api.service[61594]: *** Starting uWSGI 2.0.20-debian (64bit) on [Fri Apr 14 04:10:06 2023] *** Apr 14 04:10:06 user devstack@n-api.service[61594]: compiled with version: 11.2.0 on 21 March 2022 11:00:44 Apr 14 04:10:06 user devstack@n-api.service[61594]: os: Linux-5.15.0-67-generic #74-Ubuntu SMP Wed Feb 22 14:14:39 UTC 2023 Apr 14 04:10:06 user devstack@n-api.service[61594]: nodename: user Apr 14 04:10:06 user devstack@n-api.service[61594]: machine: x86_64 Apr 14 04:10:06 user devstack@n-api.service[61594]: clock source: unix Apr 14 04:10:06 user devstack@n-api.service[61594]: pcre jit disabled Apr 14 04:10:06 user devstack@n-api.service[61594]: detected number of CPU cores: 12 Apr 14 04:10:06 user devstack@n-api.service[61594]: current working directory: / Apr 14 04:10:06 user devstack@n-api.service[61594]: detected binary path: /usr/bin/uwsgi-core Apr 14 04:10:06 user devstack@n-api.service[61594]: your processes number limit is 63637 Apr 14 04:10:06 user devstack@n-api.service[61594]: your memory page size is 4096 bytes Apr 14 04:10:06 user devstack@n-api.service[61594]: detected max file descriptor number: 2048 Apr 14 04:10:06 user devstack@n-api.service[61594]: lock engine: pthread robust mutexes Apr 14 04:10:06 user devstack@n-api.service[61594]: thunder lock: enabled Apr 14 04:10:06 user devstack@n-api.service[61594]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Apr 14 04:10:06 user devstack@n-api.service[61594]: Python version: 3.10.6 (main, Mar 10 2023, 10:55:28) [GCC 11.3.0] Apr 14 04:10:06 user devstack@n-api.service[61594]: Python main interpreter initialized at 0x55d9cbd3c990 Apr 14 04:10:06 user devstack@n-api.service[61594]: python threads support enabled Apr 14 04:10:06 user devstack@n-api.service[61594]: your server socket listen backlog is limited to 100 connections Apr 14 04:10:06 user devstack@n-api.service[61594]: your mercy for graceful operations on workers is 90 seconds Apr 14 04:10:06 user devstack@n-api.service[61594]: mapped 537436 bytes (524 KB) for 3 cores Apr 14 04:10:06 user devstack@n-api.service[61594]: *** Operational MODE: preforking *** Apr 14 04:10:06 user devstack@n-api.service[61594]: *** uWSGI is running in multiple interpreter mode *** Apr 14 04:10:06 user devstack@n-api.service[61594]: spawned uWSGI master process (pid: 61594) Apr 14 04:10:06 user devstack@n-api.service[61594]: spawned uWSGI worker 1 (pid: 61595, cores: 1) Apr 14 04:10:06 user devstack@n-api.service[61594]: spawned uWSGI worker 2 (pid: 61596, cores: 1) Apr 14 04:10:06 user devstack@n-api.service[61594]: spawned uWSGI worker 3 (pid: 61597, cores: 1) Apr 14 04:10:06 user devstack@n-api.service[61594]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Apr 14 04:10:07 user devstack@n-api.service[61597]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 04:10:07 user devstack@n-api.service[61595]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 04:10:07 user devstack@n-api.service[61596]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 300 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = libvirt.LibvirtDriver {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] console_host = user {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = ext4 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] host = user {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.0.0.210 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.0.0.210 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = ps2mouse {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] compute.vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_wsrep_sync_wait = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_wsrep_sync_wait = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 04:10:10 user devstack@n-api.service[61597]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 04:10:10 user devstack@n-api.service[61597]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 04:10:10 user devstack@n-api.service[61597]: and ``live_migration_inbound_addr`` respectively. Apr 14 04:10:10 user devstack@n-api.service[61597]: ). Its value may be silently ignored in the future. Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 04:10:10 user devstack@n-api.service[61596]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 04:10:10 user devstack@n-api.service[61596]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 04:10:10 user devstack@n-api.service[61596]: and ``live_migration_inbound_addr`` respectively. Apr 14 04:10:10 user devstack@n-api.service[61596]: ). Its value may be silently ignored in the future. Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = custom {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: WARNING oslo_config.cfg [-] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt". Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = ['Nehalem'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_high = performance {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_governor_low = powersave {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_power_management_strategy = cpu_state {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: WARNING oslo_config.cfg [-] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal ( Apr 14 04:10:10 user devstack@n-api.service[61595]: live_migration_uri is deprecated for removal in favor of two other options that Apr 14 04:10:10 user devstack@n-api.service[61595]: allow to change live migration scheme and target URI: ``live_migration_scheme`` Apr 14 04:10:10 user devstack@n-api.service[61595]: and ``live_migration_inbound_addr`` respectively. Apr 14 04:10:10 user devstack@n-api.service[61595]: ). Its value may be silently ignored in the future. Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = qemu+ssh://stack@%s/system {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_in_placement = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61597) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.image_compression = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.jpeg_compression = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.playback_compression = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.streaming_mode = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] spice.zlib_compression = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61596) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_at_startup = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=61595) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}} Apr 14 04:10:10 user devstack@n-api.service[61597]: INFO dbcounter [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Registered counter for database nova_api Apr 14 04:10:10 user devstack@n-api.service[61596]: INFO dbcounter [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Registered counter for database nova_api Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_db.sqlalchemy.engines [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writer thread running {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_db.sqlalchemy.engines [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writer thread running {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61595]: INFO dbcounter [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Registered counter for database nova_api Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG nova.context [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e8c7b186-ea85-4588-b70f-eba063098946(cell1) {{(pid=61597) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:10:10 user devstack@n-api.service[61597]: INFO dbcounter [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Registered counter for database nova_cell0 Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_db.sqlalchemy.engines [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61595) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61597]: INFO dbcounter [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Registered counter for database nova_cell1 Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writer thread running {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_db.sqlalchemy.engines [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_db.sqlalchemy.engines [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG nova.context [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e8c7b186-ea85-4588-b70f-eba063098946(cell1) {{(pid=61596) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writer thread running {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writer thread running {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61596]: INFO dbcounter [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Registered counter for database nova_cell0 Apr 14 04:10:10 user devstack@n-api.service[61596]: INFO dbcounter [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Registered counter for database nova_cell1 Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_db.sqlalchemy.engines [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writer thread running {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_db.sqlalchemy.engines [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG nova.context [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e8c7b186-ea85-4588-b70f-eba063098946(cell1) {{(pid=61595) load_cells /opt/stack/nova/nova/context.py:464}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:10:10 user devstack@n-api.service[61595]: INFO dbcounter [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Registered counter for database nova_cell0 Apr 14 04:10:10 user devstack@n-api.service[61595]: INFO dbcounter [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Registered counter for database nova_cell1 Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_db.sqlalchemy.engines [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61595) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writer thread running {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG oslo_db.sqlalchemy.engines [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61595) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61597]: INFO dbcounter [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Registered counter for database nova_cell0 Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG oslo_db.sqlalchemy.engines [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61597) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writer thread running {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writer thread running {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61596]: INFO dbcounter [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Registered counter for database nova_cell0 Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG oslo_db.sqlalchemy.engines [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61596) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writer thread running {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:10 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writer thread running {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:11 user devstack@n-api.service[61595]: INFO dbcounter [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Registered counter for database nova_cell0 Apr 14 04:10:11 user devstack@n-api.service[61595]: DEBUG oslo_db.sqlalchemy.engines [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=61595) _check_effective_sql_mode /usr/local/lib/python3.10/dist-packages/oslo_db/sqlalchemy/engines.py:335}} Apr 14 04:10:11 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writer thread running {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:102}} Apr 14 04:10:11 user devstack@n-api.service[61597]: WARNING keystonemiddleware.auth_token [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 04:10:11 user devstack@n-api.service[61597]: WARNING keystonemiddleware.auth_token [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 04:10:11 user devstack@n-api.service[61596]: WARNING keystonemiddleware.auth_token [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 04:10:11 user devstack@n-api.service[61596]: WARNING keystonemiddleware.auth_token [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 04:10:11 user devstack@n-api.service[61595]: WARNING keystonemiddleware.auth_token [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 04:10:11 user devstack@n-api.service[61595]: WARNING keystonemiddleware.auth_token [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 04:10:11 user devstack@n-api.service[61597]: WARNING keystonemiddleware.auth_token [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 04:10:11 user devstack@n-api.service[61597]: WARNING keystonemiddleware.auth_token [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 04:10:11 user devstack@n-api.service[61597]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d9cbd3c990 pid: 61597 (default app) Apr 14 04:10:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:10:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] 10.0.0.210 "GET /compute/v2.1/" status: 200 len: 387 microversion: 2.1 time: 0.001530 Apr 14 04:10:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 1/1] 10.0.0.210 () {50 vars in 783 bytes} [Fri Apr 14 04:10:11 2023] GET /compute/v2.1/ => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:10:11 user devstack@n-api.service[61596]: WARNING keystonemiddleware.auth_token [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 04:10:11 user devstack@n-api.service[61595]: WARNING keystonemiddleware.auth_token [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Apr 14 04:10:11 user devstack@n-api.service[61596]: WARNING keystonemiddleware.auth_token [None req-efe37b2a-34b2-4cd6-b5c4-5a77a71c5706 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 04:10:11 user devstack@n-api.service[61596]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d9cbd3c990 pid: 61596 (default app) Apr 14 04:10:11 user devstack@n-api.service[61595]: WARNING keystonemiddleware.auth_token [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Apr 14 04:10:11 user devstack@n-api.service[61595]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d9cbd3c990 pid: 61595 (default app) Apr 14 04:12:20 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:20 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-679e23f8-ea0d-43e3-a861-41b8f99bdb08 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001659 Apr 14 04:12:20 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 2/2] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:20 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e1758100-927d-4e76-a680-96b0e1862c5d admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e1758100-927d-4e76-a680-96b0e1862c5d admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.386132 Apr 14 04:12:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 1/3] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 04:12:20 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002282 Apr 14 04:12:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 1/4] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:22 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:22 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:22 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:22 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:22 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:23 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-30917702-1953-4c4a-bb9d-9987d6f3a208 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "ram": 256, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-30917702-1953-4c4a-bb9d-9987d6f3a208 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.362204 Apr 14 04:12:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 3/5] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:22 2023] POST /compute/v2.1/flavors => generated 405 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:23 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-45cd88ee-5c87-4296-97b0-0bb58d9daba7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:23 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-45cd88ee-5c87-4296-97b0-0bb58d9daba7 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.089837 Apr 14 04:12:23 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 2/6] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 04:12:23 2023] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001342 Apr 14 04:12:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 2/7] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:25 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f645c76f-b153-4634-8493-ed6ee553c094 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "ds512M", "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "d1"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f645c76f-b153-4634-8493-ed6ee553c094 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.067615 Apr 14 04:12:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 4/8] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:25 2023] POST /compute/v2.1/flavors => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-caaba413-d6b4-449a-b9d5-d56eff5f143e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-caaba413-d6b4-449a-b9d5-d56eff5f143e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086079 Apr 14 04:12:25 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 3/9] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 04:12:25 2023] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:27 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:27 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002403 Apr 14 04:12:27 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 3/10] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:27 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:27 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-267d2cf5-0af9-4518-b6c7-12d887255071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "swap": 0, "os-flavor-access:is_public": true, "id": "d2", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "vcpus": 1, "ram": 1024}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-267d2cf5-0af9-4518-b6c7-12d887255071 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082263 Apr 14 04:12:27 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 5/11] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:27 2023] POST /compute/v2.1/flavors => generated 402 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:27 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2729b2d3-8daa-4658-94bc-738846f5c475 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:27 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2729b2d3-8daa-4658-94bc-738846f5c475 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029367 Apr 14 04:12:27 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 4/12] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 04:12:27 2023] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:29 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001335 Apr 14 04:12:29 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 4/13] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:29 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:29 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a070ae9d-3136-47d4-b2ce-fa0e2fcd4720 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 2048, "name": "ds2G", "swap": 0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a070ae9d-3136-47d4-b2ce-fa0e2fcd4720 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.075751 Apr 14 04:12:29 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 6/14] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:29 2023] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:29 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ff0e64fd-6c76-4556-8442-dee1c8a4cd00 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:29 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ff0e64fd-6c76-4556-8442-dee1c8a4cd00 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023303 Apr 14 04:12:29 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 5/15] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 04:12:29 2023] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001426 Apr 14 04:12:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 5/16] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:31 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4808a499-a945-4a0a-b045-e2a11cf2ad73 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "swap": 0, "rxtx_factor": 1.0, "disk": 20, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4808a499-a945-4a0a-b045-e2a11cf2ad73 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.061708 Apr 14 04:12:31 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 7/17] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:31 2023] POST /compute/v2.1/flavors => generated 402 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023152 Apr 14 04:12:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 6/18] 10.0.0.210 () {64 vars in 1329 bytes} [Fri Apr 14 04:12:31 2023] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:33 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:33 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-70e18a2c-53cd-4305-b29f-826bb6b93e62 None None] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001805 Apr 14 04:12:33 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 6/19] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:33 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:12:33 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-58ddd0dc-e900-4cd6-bca7-74bcf1602fa6 admin admin] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:33 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-58ddd0dc-e900-4cd6-bca7-74bcf1602fa6 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2096 microversion: 2.61 time: 0.093209 Apr 14 04:12:33 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 8/20] 10.0.0.210 () {60 vars in 1285 bytes} [Fri Apr 14 04:12:33 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 2096 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:12:35 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:35 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.002967 Apr 14 04:12:35 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 7/21] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:35 2023] GET /compute/v2.1 => generated 387 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:35 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:35 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:35 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:35 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:12:36 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6448bd58-1bde-4920-b243-6ce66c655507 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:36 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6448bd58-1bde-4920-b243-6ce66c655507 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 400 microversion: 2.61 time: 0.355372 Apr 14 04:12:36 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 7/22] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:35 2023] POST /compute/v2.1/flavors => generated 400 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:36 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-b8543527-293e-4b53-b719-707e85c98f4e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:36 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-b8543527-293e-4b53-b719-707e85c98f4e admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044844 Apr 14 04:12:36 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 9/23] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 04:12:36 2023] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:38 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001369 Apr 14 04:12:38 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 8/24] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:38 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1ee7421b-cedd-4864-992f-f7b389ea83d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1, "rxtx_factor": 1.0, "name": "m1.small"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1ee7421b-cedd-4864-992f-f7b389ea83d5 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.070240 Apr 14 04:12:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 8/25] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:38 2023] POST /compute/v2.1/flavors => generated 403 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Apr 14 04:12:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0e8b187f-0671-493a-b9d6-f8a57e7e292f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:38 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0e8b187f-0671-493a-b9d6-f8a57e7e292f admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026089 Apr 14 04:12:38 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 10/26] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 04:12:38 2023] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:40 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001297 Apr 14 04:12:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 9/27] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:40 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d3968869-1d6c-4c27-a46c-587e3dc2fd01 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "id": "3", "swap": 0, "ram": 4096, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 2}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d3968869-1d6c-4c27-a46c-587e3dc2fd01 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.064893 Apr 14 04:12:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 9/28] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:40 2023] POST /compute/v2.1/flavors => generated 404 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e9c2dea3-3f54-4521-86a0-fb1651324160 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e9c2dea3-3f54-4521-86a0-fb1651324160 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023572 Apr 14 04:12:40 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 11/29] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 04:12:40 2023] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:42 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:42 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001512 Apr 14 04:12:42 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 10/30] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:42 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:42 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-11dcb69a-dedb-4e94-a76c-b646cdbcee9c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 8192, "vcpus": 4, "name": "m1.large", "id": "4", "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-11dcb69a-dedb-4e94-a76c-b646cdbcee9c admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.073358 Apr 14 04:12:42 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 10/31] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:42 2023] POST /compute/v2.1/flavors => generated 403 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5eba1839-4216-4ddb-b3f0-ceafcc0ca7c4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5eba1839-4216-4ddb-b3f0-ceafcc0ca7c4 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023931 Apr 14 04:12:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 12/32] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 04:12:42 2023] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:12:44 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:12:44 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001375 Apr 14 04:12:44 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 11/33] 10.0.0.210 () {54 vars in 924 bytes} [Fri Apr 14 04:12:44 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:12:44 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ee0c5cf6-9293-4b75-8b95-58caa433b8e3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "id": "5", "swap": 0, "os-flavor-access:is_public": true}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ee0c5cf6-9293-4b75-8b95-58caa433b8e3 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.060859 Apr 14 04:12:44 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 11/34] 10.0.0.210 () {64 vars in 1276 bytes} [Fri Apr 14 04:12:44 2023] POST /compute/v2.1/flavors => generated 406 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:12:44 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-69b68bcc-4041-48fa-8b95-6cbec65ec649 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:12:44 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-69b68bcc-4041-48fa-8b95-6cbec65ec649 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023926 Apr 14 04:12:44 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 13/35] 10.0.0.210 () {64 vars in 1326 bytes} [Fri Apr 14 04:12:44 2023] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:13:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:13:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2274c83d-3a89-44e1-82a4-525634efcaa1 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001342 Apr 14 04:13:16 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 12/36] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 04:13:16 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=5 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:13:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:13:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] 10.0.0.210 "GET /compute/v2.1/os-services?binary=nova-compute&host=user" status: 200 len: 247 microversion: 2.69 time: 0.087767 Apr 14 04:13:16 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 12/37] 10.0.0.210 () {64 vars in 1388 bytes} [Fri Apr 14 04:13:16 2023] GET /compute/v2.1/os-services?binary=nova-compute&host=user => generated 247 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:13:48 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-69b68bcc-4041-48fa-8b95-6cbec65ec649 admin admin] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:13:48 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-69b68bcc-4041-48fa-8b95-6cbec65ec649 admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001469 Apr 14 04:13:48 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 14/38] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 04:13:48 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:13:48 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=32,nova_api:SAVEPOINT=5,nova_api:INSERT=5,nova_api:RELEASE=5 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:13:48 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-542184aa-7db4-4460-9cd3-8398992c2367 admin admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:13:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-542184aa-7db4-4460-9cd3-8398992c2367 admin admin] 10.0.0.210 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4182 microversion: 2.61 time: 0.088119 Apr 14 04:13:48 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 13/39] 10.0.0.210 () {64 vars in 1367 bytes} [Fri Apr 14 04:13:48 2023] GET /compute/v2.1/flavors/detail?is_public=True => generated 4182 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:13:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:13:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001606 Apr 14 04:13:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 13/40] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 04:13:52 2023] GET /compute/v2.1 => generated 387 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:13:52 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:13:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ddc357df-caca-47fd-801c-571a22527a7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 128, "name": "m1.nano", "id": "42"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:13:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ddc357df-caca-47fd-801c-571a22527a7b admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 403 microversion: 2.61 time: 0.101732 Apr 14 04:13:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 15/41] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 04:13:52 2023] POST /compute/v2.1/flavors => generated 403 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:13:52 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2a2b594e-3173-48cc-82c4-2cb8b715fdc2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:13:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2a2b594e-3173-48cc-82c4-2cb8b715fdc2 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.025395 Apr 14 04:13:52 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 14/42] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 04:13:52 2023] POST /compute/v2.1/flavors/42/os-extra_specs => generated 43 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:13:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:13:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-17f22b15-7953-4bad-ace7-b1b29481fd4c admin admin] 10.0.0.210 "GET /compute/v2.1" status: 200 len: 387 microversion: 2.1 time: 0.001458 Apr 14 04:13:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 14/43] 10.0.0.210 () {58 vars in 1006 bytes} [Fri Apr 14 04:13:56 2023] GET /compute/v2.1 => generated 387 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:13:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2fc5767b-c902-4a37-aa23-8b714f679169 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 192, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "84", "disk": 1, "name": "m1.micro"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:13:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2fc5767b-c902-4a37-aa23-8b714f679169 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.073539 Apr 14 04:13:56 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 16/44] 10.0.0.210 () {68 vars in 1358 bytes} [Fri Apr 14 04:13:56 2023] POST /compute/v2.1/flavors => generated 404 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:13:56 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d80cf5d4-d7fb-415b-acac-03ab7bd91081 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:13:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d80cf5d4-d7fb-415b-acac-03ab7bd91081 admin admin] 10.0.0.210 "POST /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.023124 Apr 14 04:13:56 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 15/45] 10.0.0.210 () {68 vars in 1411 bytes} [Fri Apr 14 04:13:56 2023] POST /compute/v2.1/flavors/84/os-extra_specs => generated 43 bytes in 24 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ee68f9e7-dc5a-4fb6-a68a-daee1c9163a2 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bd877f0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ee68f9e7-dc5a-4fb6-a68a-daee1c9163a2 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/592547ad-a107-4cca-b4b4-db1df5964f37" status: 200 len: 350 microversion: 2.1 time: 0.259729 Apr 14 04:16:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 15/46] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:16:12 2023] GET /compute/v2.1/os-volumes/592547ad-a107-4cca-b4b4-db1df5964f37 => generated 350 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:15 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=6,nova_api:INSERT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8bdebf52-6e66-43ed-8e0e-8d18d7d7a562 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bd99a20>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-8bdebf52-6e66-43ed-8e0e-8d18d7d7a562 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/006d9258-df4b-41b8-80a3-b57ea869fc53" status: 200 len: 351 microversion: 2.1 time: 0.163563 Apr 14 04:16:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 17/47] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:16:15 2023] GET /compute/v2.1/os-volumes/006d9258-df4b-41b8-80a3-b57ea869fc53 => generated 351 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:17 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=2,nova_api:RELEASE=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-72903ee1-a16d-4fd3-9e80-62981b495993 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538be751b0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-72903ee1-a16d-4fd3-9e80-62981b495993 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/393464b8-923a-4f32-a9c6-3f1b6b5e0b53" status: 200 len: 351 microversion: 2.1 time: 0.193903 Apr 14 04:16:18 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 16/48] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:16:17 2023] GET /compute/v2.1/os-volumes/393464b8-923a-4f32-a9c6-3f1b6b5e0b53 => generated 351 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3150b106-861d-41de-beec-4b1bd9903d95 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bd87130>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3150b106-861d-41de-beec-4b1bd9903d95 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.123654 Apr 14 04:16:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 16/49] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-14ec5911-34e0-408e-9d11-fbd450ed5751 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bf8bf40>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-14ec5911-34e0-408e-9d11-fbd450ed5751 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.105195 Apr 14 04:16:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 18/50] 10.0.0.210 () {62 vars in 1226 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7d33b818-ad4b-4aa5-864e-af8bbc847fc1 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bc0f490>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7d33b818-ad4b-4aa5-864e-af8bbc847fc1 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.082634 Apr 14 04:16:18 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 17/51] 10.0.0.210 () {62 vars in 1211 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-144a6b66-4458-480b-95b3-5db421b24518 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bc29c60>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-144a6b66-4458-480b-95b3-5db421b24518 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110490 Apr 14 04:16:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 17/52] 10.0.0.210 () {62 vars in 1244 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ce200152-e455-46c0-bc8a-b5672b678866 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bc409d0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ce200152-e455-46c0-bc8a-b5672b678866 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.125044 Apr 14 04:16:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 19/53] 10.0.0.210 () {62 vars in 1247 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-aa92b488-9b5c-4b85-b7e5-79c5ce4314bc tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bc28820>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-aa92b488-9b5c-4b85-b7e5-79c5ce4314bc tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.087047 Apr 14 04:16:18 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 18/54] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3736c66f-6c19-46e4-a238-e12b01b917c3 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bd87250>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3736c66f-6c19-46e4-a238-e12b01b917c3 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.099865 Apr 14 04:16:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 18/55] 10.0.0.210 () {62 vars in 1265 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-b1db975c-8ca4-4ea7-b378-0fb42a9abc27 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] Calling method '.version_select at 0x7f538bc40a60>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-b1db975c-8ca4-4ea7-b378-0fb42a9abc27 tempest-VolumesTestJSON-1547245948 tempest-VolumesTestJSON-1547245948-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092861 Apr 14 04:16:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 20/56] 10.0.0.210 () {62 vars in 1232 bytes} [Fri Apr 14 04:16:18 2023] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:19 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-41d4d788-cc79-4c2e-a945-2c4a0a4fae1b tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'create', calling method: .version_select at 0x7f538bf63ac0>, body: {"keypair": {"name": "tempest-keypair-1428467741", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBY2UT8M9EXLRm2waCk4jzyD2YisXrBUU8nZo6LT6g0AlR0LbKytQJ1iJL1X5k+1hK+8YQxwsn1kgdkATbgdoU6lyDlwBLIIaqdqxbWOahpeOBX2u8LLHQwm2K/x2XVeAg=="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:19 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-844517641", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "3019ebd6-056f-4b16-98f1-6aabc843f05d"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:19 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-41d4d788-cc79-4c2e-a945-2c4a0a4fae1b tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for project 6a89255339f74e55ad7c92967558bb81. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:19 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-41d4d788-cc79-4c2e-a945-2c4a0a4fae1b tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for user 7610b45003e34f3395268977612f6c94 and project 6a89255339f74e55ad7c92967558bb81. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-41d4d788-cc79-4c2e-a945-2c4a0a4fae1b tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.190083 Apr 14 04:16:19 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 19/57] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:16:19 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:19 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] validate_networks() for [('3019ebd6-056f-4b16-98f1-6aabc843f05d', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Getting quotas for project 280aa55745a749b7baa134334d25c9c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Getting quotas for user 6e422970cd8340bf996a135088094f51 and project 280aa55745a749b7baa134334d25c9c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:21 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 0ff97860-2441-437c-b118-6089c3cc4160] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-30edb0e7-f91e-4b6f-9711-7074ee219958 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.900645 Apr 14 04:16:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 19/58] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:19 2023] POST /compute/v2.1/servers => generated 378 bytes in 1903 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:16:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f2ddbd28-5b1c-4f66-8e16-b723fdd3e335 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:21 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f2ddbd28-5b1c-4f66-8e16-b723fdd3e335 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 0ff97860-2441-437c-b118-6089c3cc4160] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:21 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-f2ddbd28-5b1c-4f66-8e16-b723fdd3e335 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e422970cd8340bf996a135088094f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280aa55745a749b7baa134334d25c9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f2ddbd28-5b1c-4f66-8e16-b723fdd3e335 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160" status: 200 len: 1207 microversion: 2.1 time: 0.176117 Apr 14 04:16:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 21/59] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:21 2023] GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160 => generated 1207 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1687697238", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "a462dbfb-12e1-48c7-a797-87823269af2a"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:23 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] validate_networks() for [('a462dbfb-12e1-48c7-a797-87823269af2a', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Getting quotas for project bae0fb4af555422a847620627dffeae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Getting quotas for user ea68fb139b004f748cf1bcfb8d675a2e and project bae0fb4af555422a847620627dffeae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:24 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:24 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-08a8d46c-70b4-4f37-884c-7809afae0e93 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.543475 Apr 14 04:16:24 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 20/60] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:22 2023] POST /compute/v2.1/servers => generated 378 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:16:24 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-c12fb9ae-e4e8-4805-83cf-26eb56e2d990 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:24 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-c12fb9ae-e4e8-4805-83cf-26eb56e2d990 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:24 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-c12fb9ae-e4e8-4805-83cf-26eb56e2d990 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:24 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-c12fb9ae-e4e8-4805-83cf-26eb56e2d990 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 200 len: 1211 microversion: 2.1 time: 0.388036 Apr 14 04:16:24 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 20/61] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:24 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 1211 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:30 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1781752187", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f3cc5345-2e8a-458b-9670-1a780db6a37c"}], "security_groups": [{"name": "tempest-securitygroup--1327956410"}], "key_name": "tempest-keypair-1428467741", "user_data": "}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-ac4ff65a-557a-4c8d-a64e-96e319749867 req-45263051-7492-400d-9f96-5b461fdcb6d7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9b532a44-20b7-4590-babe-684c49598a62", "tag": "c45f9c53-8d5c-4b47-8e0a-ebb292cefb06"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ac4ff65a-557a-4c8d-a64e-96e319749867 req-45263051-7492-400d-9f96-5b461fdcb6d7 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ac4ff65a-557a-4c8d-a64e-96e319749867 req-45263051-7492-400d-9f96-5b461fdcb6d7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ac4ff65a-557a-4c8d-a64e-96e319749867 req-45263051-7492-400d-9f96-5b461fdcb6d7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ac4ff65a-557a-4c8d-a64e-96e319749867 req-45263051-7492-400d-9f96-5b461fdcb6d7 service nova] Creating event network-changed:c45f9c53-8d5c-4b47-8e0a-ebb292cefb06 for instance 9b532a44-20b7-4590-babe-684c49598a62 on user Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ac4ff65a-557a-4c8d-a64e-96e319749867 req-45263051-7492-400d-9f96-5b461fdcb6d7 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61596) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ac4ff65a-557a-4c8d-a64e-96e319749867 req-45263051-7492-400d-9f96-5b461fdcb6d7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61596) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:30 user devstack@n-api.service[61596]: INFO nova.compute.rpcapi [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 04:16:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=61596) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 04:16:30 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] validate_networks() for [('f3cc5345-2e8a-458b-9670-1a780db6a37c', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-9e63fa92-58a6-49c3-ad0e-9425979f68e4 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153395 Apr 14 04:16:30 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 21/62] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:30 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:30 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-44f44b5d-b879-4bb7-a2b2-e0c7bc59444e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'create', calling method: .version_select at 0x7f538b310820>, body: {"keypair": {"name": "tempest-keypair-964114001", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFhQVAon6iUmWgfiTnbVVO2wSLx2ACi4ZUupr/3b/O255im7X/6hIJW49PlgfIgMrBQ+6w5QNr5f28LOri03H7nhpJeLG+aJessXLUSHzOfJ6DGDJhDGy+XFKNWimHOKdQ=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:30 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-44f44b5d-b879-4bb7-a2b2-e0c7bc59444e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:30 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-44f44b5d-b879-4bb7-a2b2-e0c7bc59444e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for user e35b3ae371cf4dd4b21e2999e58cd2f4 and project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-44f44b5d-b879-4bb7-a2b2-e0c7bc59444e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.164134 Apr 14 04:16:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 21/63] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:16:30 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-417129e4-3423-4518-a8f7-a56cbac38a48 req-72fa39a9-c49b-489f-bda4-40b14b1491fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0ff97860-2441-437c-b118-6089c3cc4160", "tag": "22212b8b-6656-4d88-ad5c-e0d8f657062f"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-417129e4-3423-4518-a8f7-a56cbac38a48 req-72fa39a9-c49b-489f-bda4-40b14b1491fd service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-417129e4-3423-4518-a8f7-a56cbac38a48 req-72fa39a9-c49b-489f-bda4-40b14b1491fd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-417129e4-3423-4518-a8f7-a56cbac38a48 req-72fa39a9-c49b-489f-bda4-40b14b1491fd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-417129e4-3423-4518-a8f7-a56cbac38a48 req-72fa39a9-c49b-489f-bda4-40b14b1491fd service nova] Creating event network-changed:22212b8b-6656-4d88-ad5c-e0d8f657062f for instance 0ff97860-2441-437c-b118-6089c3cc4160 on user Apr 14 04:16:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-417129e4-3423-4518-a8f7-a56cbac38a48 req-72fa39a9-c49b-489f-bda4-40b14b1491fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110646 Apr 14 04:16:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 22/64] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:31 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:31 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for project 6a89255339f74e55ad7c92967558bb81. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for user 7610b45003e34f3395268977612f6c94 and project 6a89255339f74e55ad7c92967558bb81. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:32 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:32 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-55e086f4-a6e5-496f-80c4-46501ae83824 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 2.582233 Apr 14 04:16:32 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 22/65] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:30 2023] POST /compute/v2.1/servers => generated 400 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:16:32 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:32 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a07ee53b-2c16-4433-bc5a-b6b775fa0599 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:32 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-a07ee53b-2c16-4433-bc5a-b6b775fa0599 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:33 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-a07ee53b-2c16-4433-bc5a-b6b775fa0599 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:33 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a07ee53b-2c16-4433-bc5a-b6b775fa0599 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1232 microversion: 2.1 time: 0.300643 Apr 14 04:16:33 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 22/66] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:32 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1232 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:35 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=10 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-238847393", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "2067a33c-66ab-4b9b-a1d5-a8dbb603f119"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:36 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] validate_networks() for [('2067a33c-66ab-4b9b-a1d5-a8dbb603f119', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Getting quotas for project ce5e634f187b470085e7bfb3c1cfcbe7. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Getting quotas for user fab852bb302f44b1af63083c99ea244c and project ce5e634f187b470085e7bfb3c1cfcbe7. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:37 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-47e05cd5-3805-4bd5-b160-70cae4a76836 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.737303 Apr 14 04:16:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 23/67] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:35 2023] POST /compute/v2.1/servers => generated 378 bytes in 1739 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:16:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3ba57121-8a6b-48d1-ba46-90ee3292519e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:37 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3ba57121-8a6b-48d1-ba46-90ee3292519e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0cd80788-f9de-450d-b97a-967688e022b1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Action: 'create', calling method: .version_select at 0x7f538bb34670>, body: {"keypair": {"name": "tempest-keypair-234703296", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHsERCJfV5vlojYp6CtYNDuskD1mPJwApYPpyopwqnFEg3bukLlc5MC0Mx5e6kcUmmhflLvGI9V/TTXxf//CKjD9nOwYO+5pKfSRGQB3deK57Z7HLLcWkH9v7l2Z+jP7Gg=="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:37 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-0cd80788-f9de-450d-b97a-967688e022b1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Getting quotas for project 15bb9ddec81e4f6cbceb6ce7dee9c3a1. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:37 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-0cd80788-f9de-450d-b97a-967688e022b1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Getting quotas for user 676d80d3684045298d895555247174af and project 15bb9ddec81e4f6cbceb6ce7dee9c3a1. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:37 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-3ba57121-8a6b-48d1-ba46-90ee3292519e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab852bb302f44b1af63083c99ea244c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5e634f187b470085e7bfb3c1cfcbe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3ba57121-8a6b-48d1-ba46-90ee3292519e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb" status: 200 len: 1208 microversion: 2.1 time: 0.159411 Apr 14 04:16:37 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 23/68] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:37 2023] GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb => generated 1208 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0cd80788-f9de-450d-b97a-967688e022b1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.342979 Apr 14 04:16:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 23/69] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:16:37 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:38 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-51414bde-9998-4cd9-98c4-270144332180 req-ffc7f5ab-289f-4f5e-a3db-b0ee2a27a4ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff97860-2441-437c-b118-6089c3cc4160", "name": "network-vif-plugged", "status": "completed", "tag": "22212b8b-6656-4d88-ad5c-e0d8f657062f"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-51414bde-9998-4cd9-98c4-270144332180 req-ffc7f5ab-289f-4f5e-a3db-b0ee2a27a4ff service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-51414bde-9998-4cd9-98c4-270144332180 req-ffc7f5ab-289f-4f5e-a3db-b0ee2a27a4ff service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-51414bde-9998-4cd9-98c4-270144332180 req-ffc7f5ab-289f-4f5e-a3db-b0ee2a27a4ff service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-51414bde-9998-4cd9-98c4-270144332180 req-ffc7f5ab-289f-4f5e-a3db-b0ee2a27a4ff service nova] Creating event network-vif-plugged:22212b8b-6656-4d88-ad5c-e0d8f657062f for instance 0ff97860-2441-437c-b118-6089c3cc4160 on user Apr 14 04:16:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-51414bde-9998-4cd9-98c4-270144332180 req-ffc7f5ab-289f-4f5e-a3db-b0ee2a27a4ff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039277 Apr 14 04:16:38 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 24/70] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-1350614351", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "2fe4c44a-0ec3-4df5-a079-ae920ed93fe7"}], "security_groups": [{"name": "tempest-securitygroup--47068274"}], "key_name": "tempest-keypair-964114001", "user_data": "}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1529931408", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:38 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] validate_networks() for [('b413a761-e152-48ff-a963-b8e2cbab4a86', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:39 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] validate_networks() for [('2fe4c44a-0ec3-4df5-a079-ae920ed93fe7', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-10e33f75-10de-4436-84db-6d5b7f7b3b56 req-6742e0b8-01da-414b-ba94-b7526a330f05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff97860-2441-437c-b118-6089c3cc4160", "name": "network-vif-plugged", "status": "completed", "tag": "22212b8b-6656-4d88-ad5c-e0d8f657062f"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-10e33f75-10de-4436-84db-6d5b7f7b3b56 req-6742e0b8-01da-414b-ba94-b7526a330f05 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-10e33f75-10de-4436-84db-6d5b7f7b3b56 req-6742e0b8-01da-414b-ba94-b7526a330f05 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-10e33f75-10de-4436-84db-6d5b7f7b3b56 req-6742e0b8-01da-414b-ba94-b7526a330f05 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-10e33f75-10de-4436-84db-6d5b7f7b3b56 req-6742e0b8-01da-414b-ba94-b7526a330f05 service nova] Creating event network-vif-plugged:22212b8b-6656-4d88-ad5c-e0d8f657062f for instance 0ff97860-2441-437c-b118-6089c3cc4160 on user Apr 14 04:16:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-10e33f75-10de-4436-84db-6d5b7f7b3b56 req-6742e0b8-01da-414b-ba94-b7526a330f05 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043027 Apr 14 04:16:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 25/71] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-ab3df53d-3a74-4d81-b4e8-d2ad535ec82e req-32484043-0f72-4e7f-be3a-3775b632652f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b532a44-20b7-4590-babe-684c49598a62", "name": "network-vif-plugged", "status": "completed", "tag": "c45f9c53-8d5c-4b47-8e0a-ebb292cefb06"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ab3df53d-3a74-4d81-b4e8-d2ad535ec82e req-32484043-0f72-4e7f-be3a-3775b632652f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ab3df53d-3a74-4d81-b4e8-d2ad535ec82e req-32484043-0f72-4e7f-be3a-3775b632652f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ab3df53d-3a74-4d81-b4e8-d2ad535ec82e req-32484043-0f72-4e7f-be3a-3775b632652f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ab3df53d-3a74-4d81-b4e8-d2ad535ec82e req-32484043-0f72-4e7f-be3a-3775b632652f service nova] Creating event network-vif-plugged:c45f9c53-8d5c-4b47-8e0a-ebb292cefb06 for instance 9b532a44-20b7-4590-babe-684c49598a62 on user Apr 14 04:16:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-ab3df53d-3a74-4d81-b4e8-d2ad535ec82e req-32484043-0f72-4e7f-be3a-3775b632652f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045317 Apr 14 04:16:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 26/72] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for user 5234914aec8e443b8a38ac6b38729031 and project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5ad3c5ec-6f72-465f-af20-cd4bc21c04b4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.437149 Apr 14 04:16:41 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 24/73] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:38 2023] POST /compute/v2.1/servers => generated 381 bytes in 2438 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 04:16:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-9aad5784-cfab-4a46-977e-89d5d0807f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:41 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-9aad5784-cfab-4a46-977e-89d5d0807f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-9aad5784-cfab-4a46-977e-89d5d0807f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for user e35b3ae371cf4dd4b21e2999e58cd2f4 and project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:41 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-9aad5784-cfab-4a46-977e-89d5d0807f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 200 len: 1216 microversion: 2.1 time: 0.485992 Apr 14 04:16:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 27/74] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:41 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 1216 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1602894262", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-322c274f-4d8b-4248-9252-4b8acab0183b tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 3.203598 Apr 14 04:16:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 24/75] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:38 2023] POST /compute/v2.1/servers => generated 405 bytes in 3207 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:16:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2e6d20bf-36b1-4c97-b69b-60ef40edcf09 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:41 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-2e6d20bf-36b1-4c97-b69b-60ef40edcf09 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:41 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] validate_networks() for [('b413a761-e152-48ff-a963-b8e2cbab4a86', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:42 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-2e6d20bf-36b1-4c97-b69b-60ef40edcf09 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:42 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2e6d20bf-36b1-4c97-b69b-60ef40edcf09 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1232 microversion: 2.1 time: 0.517342 Apr 14 04:16:42 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 28/76] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:41 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1232 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b532a44-20b7-4590-babe-684c49598a62", "name": "network-vif-plugged", "status": "completed", "tag": "c45f9c53-8d5c-4b47-8e0a-ebb292cefb06"}, {"name": "network-changed", "server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=7 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Creating event network-vif-plugged:c45f9c53-8d5c-4b47-8e0a-ebb292cefb06 for instance 9b532a44-20b7-4590-babe-684c49598a62 on user Apr 14 04:16:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Creating event network-changed:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61595) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-495df739-5682-4926-93e2-99dc8cf9979f req-2c3b2454-238d-4bfc-b032-e5b2808cbf24 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61595) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:42 user devstack@n-api.service[61595]: INFO nova.compute.rpcapi [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 04:16:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] Releasing lock "compute-rpcapi-router" {{(pid=61595) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 04:16:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a70d36a7-4c29-4d8b-8c88-348a2878b010 None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.125278 Apr 14 04:16:42 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 25/77] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:42 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for user 5234914aec8e443b8a38ac6b38729031 and project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:44 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:44 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-da85801e-a6ab-44ca-aed3-ba6fbea0c1ab tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 381 microversion: 2.1 time: 2.703688 Apr 14 04:16:44 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 25/78] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:41 2023] POST /compute/v2.1/servers => generated 381 bytes in 2705 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:16:44 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-aca1278d-f267-45d0-b985-1603fa566dcd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:44 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-aca1278d-f267-45d0-b985-1603fa566dcd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:44 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-aca1278d-f267-45d0-b985-1603fa566dcd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:44 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-aca1278d-f267-45d0-b985-1603fa566dcd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a" status: 200 len: 1216 microversion: 2.1 time: 0.194758 Apr 14 04:16:44 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 29/79] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:44 2023] GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a => generated 1216 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-395aef29-4a39-4656-8ea2-db2a81ac9959 req-be1cf71e-ff66-4c9d-b5c8-e33774e0c5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e37e27b4-0813-4df9-ac66-1516334c12cb", "tag": "2a342575-05e3-4179-a370-6d39ac4f815d"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-395aef29-4a39-4656-8ea2-db2a81ac9959 req-be1cf71e-ff66-4c9d-b5c8-e33774e0c5c0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-395aef29-4a39-4656-8ea2-db2a81ac9959 req-be1cf71e-ff66-4c9d-b5c8-e33774e0c5c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-395aef29-4a39-4656-8ea2-db2a81ac9959 req-be1cf71e-ff66-4c9d-b5c8-e33774e0c5c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:45 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-395aef29-4a39-4656-8ea2-db2a81ac9959 req-be1cf71e-ff66-4c9d-b5c8-e33774e0c5c0 service nova] Creating event network-changed:2a342575-05e3-4179-a370-6d39ac4f815d for instance e37e27b4-0813-4df9-ac66-1516334c12cb on user Apr 14 04:16:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-395aef29-4a39-4656-8ea2-db2a81ac9959 req-be1cf71e-ff66-4c9d-b5c8-e33774e0c5c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047192 Apr 14 04:16:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 26/80] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:45 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerStableDeviceRescueTest-server-1335768391", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "97d3cce1-27a3-4e76-9d3f-44860a2a8dcf"}], "security_groups": [{"name": "tempest-securitygroup--1611053229"}], "key_name": "tempest-keypair-234703296", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=10 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:46 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] validate_networks() for [('97d3cce1-27a3-4e76-9d3f-44860a2a8dcf', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Getting quotas for project 15bb9ddec81e4f6cbceb6ce7dee9c3a1. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Getting quotas for user 676d80d3684045298d895555247174af and project 15bb9ddec81e4f6cbceb6ce7dee9c3a1. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:16:47 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:16:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fd89ffb3-188b-4f85-8f59-d28932ea04dc tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.364742 Apr 14 04:16:47 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 26/81] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:46 2023] POST /compute/v2.1/servers => generated 404 bytes in 1366 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:16:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-48c81918-1f01-4e22-9064-72eba2ed7978 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:16:47 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-48c81918-1f01-4e22-9064-72eba2ed7978 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:16:47 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:47 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-48c81918-1f01-4e22-9064-72eba2ed7978 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d80d3684045298d895555247174af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bb9ddec81e4f6cbceb6ce7dee9c3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:16:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-48c81918-1f01-4e22-9064-72eba2ed7978 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 200 len: 1239 microversion: 2.1 time: 0.192956 Apr 14 04:16:47 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 30/82] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:16:47 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 1239 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:16:48 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-e3891da0-1508-480d-9ee3-f28d38e36060 req-dcc325c6-e9ff-4d6c-b01b-749b6cb10736 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e3891da0-1508-480d-9ee3-f28d38e36060 req-dcc325c6-e9ff-4d6c-b01b-749b6cb10736 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e3891da0-1508-480d-9ee3-f28d38e36060 req-dcc325c6-e9ff-4d6c-b01b-749b6cb10736 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e3891da0-1508-480d-9ee3-f28d38e36060 req-dcc325c6-e9ff-4d6c-b01b-749b6cb10736 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:48 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e3891da0-1508-480d-9ee3-f28d38e36060 req-dcc325c6-e9ff-4d6c-b01b-749b6cb10736 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:16:48 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-e3891da0-1508-480d-9ee3-f28d38e36060 req-dcc325c6-e9ff-4d6c-b01b-749b6cb10736 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056484 Apr 14 04:16:48 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 27/83] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-4ec13115-161a-4aa6-9f9c-9a9a90e53f56 req-69e4541b-7f4d-40c9-9cb2-657847625cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4ec13115-161a-4aa6-9f9c-9a9a90e53f56 req-69e4541b-7f4d-40c9-9cb2-657847625cb9 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4ec13115-161a-4aa6-9f9c-9a9a90e53f56 req-69e4541b-7f4d-40c9-9cb2-657847625cb9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4ec13115-161a-4aa6-9f9c-9a9a90e53f56 req-69e4541b-7f4d-40c9-9cb2-657847625cb9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:50 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-4ec13115-161a-4aa6-9f9c-9a9a90e53f56 req-69e4541b-7f4d-40c9-9cb2-657847625cb9 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4ec13115-161a-4aa6-9f9c-9a9a90e53f56 req-69e4541b-7f4d-40c9-9cb2-657847625cb9 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=61597) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4ec13115-161a-4aa6-9f9c-9a9a90e53f56 req-69e4541b-7f4d-40c9-9cb2-657847625cb9 service nova] Acquired lock "compute-rpcapi-router" {{(pid=61597) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:50 user devstack@n-api.service[61597]: INFO nova.compute.rpcapi [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Automatically selected compute RPC version 6.2 from minimum service version 66 Apr 14 04:16:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] Releasing lock "compute-rpcapi-router" {{(pid=61597) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}} Apr 14 04:16:50 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f4e000e8-ddf4-49b2-8a51-1c65dffd05bb None None] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.154708 Apr 14 04:16:50 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 27/84] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-ff9b7939-6f4a-44fc-92ea-284574a82dec req-7672bbac-a7a2-45ed-bcb6-695501bb33ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37e27b4-0813-4df9-ac66-1516334c12cb", "name": "network-vif-plugged", "status": "completed", "tag": "2a342575-05e3-4179-a370-6d39ac4f815d"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ff9b7939-6f4a-44fc-92ea-284574a82dec req-7672bbac-a7a2-45ed-bcb6-695501bb33ad service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ff9b7939-6f4a-44fc-92ea-284574a82dec req-7672bbac-a7a2-45ed-bcb6-695501bb33ad service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ff9b7939-6f4a-44fc-92ea-284574a82dec req-7672bbac-a7a2-45ed-bcb6-695501bb33ad service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=17 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ff9b7939-6f4a-44fc-92ea-284574a82dec req-7672bbac-a7a2-45ed-bcb6-695501bb33ad service nova] Creating event network-vif-plugged:2a342575-05e3-4179-a370-6d39ac4f815d for instance e37e27b4-0813-4df9-ac66-1516334c12cb on user Apr 14 04:16:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-ff9b7939-6f4a-44fc-92ea-284574a82dec req-7672bbac-a7a2-45ed-bcb6-695501bb33ad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099498 Apr 14 04:16:50 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 31/85] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-c5d9b6a2-8cef-478c-a775-36fe6d74b6db req-6532d325-6ff7-47a5-bdf3-2b4f32d79afc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"name": "network-changed", "server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:52 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=22 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c5d9b6a2-8cef-478c-a775-36fe6d74b6db req-6532d325-6ff7-47a5-bdf3-2b4f32d79afc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c5d9b6a2-8cef-478c-a775-36fe6d74b6db req-6532d325-6ff7-47a5-bdf3-2b4f32d79afc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c5d9b6a2-8cef-478c-a775-36fe6d74b6db req-6532d325-6ff7-47a5-bdf3-2b4f32d79afc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-c5d9b6a2-8cef-478c-a775-36fe6d74b6db req-6532d325-6ff7-47a5-bdf3-2b4f32d79afc service nova] Creating event network-changed:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:16:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-c5d9b6a2-8cef-478c-a775-36fe6d74b6db req-6532d325-6ff7-47a5-bdf3-2b4f32d79afc service nova] Creating event network-changed:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:16:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-c5d9b6a2-8cef-478c-a775-36fe6d74b6db req-6532d325-6ff7-47a5-bdf3-2b4f32d79afc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.128492 Apr 14 04:16:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 28/86] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:52 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-07bd9b15-122a-4ea8-b613-836a874becdf req-8abd6fe9-e685-40aa-be0d-8bbf081e6af7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}, {"server_uuid": "e37e27b4-0813-4df9-ac66-1516334c12cb", "name": "network-vif-plugged", "status": "completed", "tag": "2a342575-05e3-4179-a370-6d39ac4f815d"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-07bd9b15-122a-4ea8-b613-836a874becdf req-8abd6fe9-e685-40aa-be0d-8bbf081e6af7 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-07bd9b15-122a-4ea8-b613-836a874becdf req-8abd6fe9-e685-40aa-be0d-8bbf081e6af7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-07bd9b15-122a-4ea8-b613-836a874becdf req-8abd6fe9-e685-40aa-be0d-8bbf081e6af7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-07bd9b15-122a-4ea8-b613-836a874becdf req-8abd6fe9-e685-40aa-be0d-8bbf081e6af7 service nova] Creating event network-changed:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:16:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-07bd9b15-122a-4ea8-b613-836a874becdf req-8abd6fe9-e685-40aa-be0d-8bbf081e6af7 service nova] Creating event network-vif-plugged:2a342575-05e3-4179-a370-6d39ac4f815d for instance e37e27b4-0813-4df9-ac66-1516334c12cb on user Apr 14 04:16:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-07bd9b15-122a-4ea8-b613-836a874becdf req-8abd6fe9-e685-40aa-be0d-8bbf081e6af7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.059723 Apr 14 04:16:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 28/87] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:52 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:55 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b133a6d4-00b5-4842-be07-df43d61f562d tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Action: 'create', calling method: .version_select at 0x7f538bb79240>, body: {"keypair": {"name": "tempest-keypair-2075478387", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP2a/q8z148VuqmzCdTppqcm7Q47cCuI3B0oR8ww+C0FRQKet9rnqUXrh5enWkvTgHjdhAOOgHwD+H7zMvAp4yzILDVjHd5SWnmFQ8IxBan80X7GvaW+XLPf39HLZ/j3xA=="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:55 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-b133a6d4-00b5-4842-be07-df43d61f562d tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Getting quotas for project e0e636ba0ee9486f9f48905d886ab547. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:55 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-b133a6d4-00b5-4842-be07-df43d61f562d tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Getting quotas for user d1b09bc7a0344ae782d33d3222a8ea88 and project e0e636ba0ee9486f9f48905d886ab547. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b133a6d4-00b5-4842-be07-df43d61f562d tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.543633 Apr 14 04:16:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 32/88] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:16:55 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-1fb678ce-d735-4117-bedd-d2697e47d467 req-00c73996-c11b-4765-a317-c00010f96cef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1fb678ce-d735-4117-bedd-d2697e47d467 req-00c73996-c11b-4765-a317-c00010f96cef service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1fb678ce-d735-4117-bedd-d2697e47d467 req-00c73996-c11b-4765-a317-c00010f96cef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1fb678ce-d735-4117-bedd-d2697e47d467 req-00c73996-c11b-4765-a317-c00010f96cef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-1fb678ce-d735-4117-bedd-d2697e47d467 req-00c73996-c11b-4765-a317-c00010f96cef service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:16:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-1fb678ce-d735-4117-bedd-d2697e47d467 req-00c73996-c11b-4765-a317-c00010f96cef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.151119 Apr 14 04:16:57 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 29/89] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-cfabc037-54a5-4ae1-b01a-faadd6256cbf tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Action: 'create', calling method: .version_select at 0x7f538bb795a0>, body: {"keypair": {"name": "tempest-keypair-330344245", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBvOf9hss+Yqylm6PnX6la1ymm/55r9GRsHJ0NsNe4bgFVG/3wZy3kBc49f/xLbrJ51dzLLHr/o6IQVXcYhlDKHgp4DCKWnVv/anFtE+/Na/vdZgAYvQkLcZYHFyD4dFRQ=="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-3fefd8cf-7541-4c98-a30a-10f493ce999b req-21bef985-711f-4dbb-abb8-64fbb7dad434 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-plugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:57 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-cfabc037-54a5-4ae1-b01a-faadd6256cbf tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Getting quotas for project 01cefa66350a4432ad71204b39e953be. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:16:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3fefd8cf-7541-4c98-a30a-10f493ce999b req-21bef985-711f-4dbb-abb8-64fbb7dad434 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3fefd8cf-7541-4c98-a30a-10f493ce999b req-21bef985-711f-4dbb-abb8-64fbb7dad434 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:57 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-cfabc037-54a5-4ae1-b01a-faadd6256cbf tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Getting quotas for user 0aeeeae7cbc340daa8cd81c1418794e0 and project 01cefa66350a4432ad71204b39e953be. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:16:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3fefd8cf-7541-4c98-a30a-10f493ce999b req-21bef985-711f-4dbb-abb8-64fbb7dad434 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-3fefd8cf-7541-4c98-a30a-10f493ce999b req-21bef985-711f-4dbb-abb8-64fbb7dad434 service nova] Creating event network-vif-plugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-aa2641e2-d08c-4435-8ed1-b0a7991d3110 req-1fb74761-0180-4270-9c94-2a03851a3a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-3fefd8cf-7541-4c98-a30a-10f493ce999b req-21bef985-711f-4dbb-abb8-64fbb7dad434 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076989 Apr 14 04:16:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 33/90] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-cfabc037-54a5-4ae1-b01a-faadd6256cbf tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.49 time: 0.118227 Apr 14 04:16:57 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 29/91] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 04:16:57 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 120 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-aa2641e2-d08c-4435-8ed1-b0a7991d3110 req-1fb74761-0180-4270-9c94-2a03851a3a73 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-aa2641e2-d08c-4435-8ed1-b0a7991d3110 req-1fb74761-0180-4270-9c94-2a03851a3a73 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-aa2641e2-d08c-4435-8ed1-b0a7991d3110 req-1fb74761-0180-4270-9c94-2a03851a3a73 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-aa2641e2-d08c-4435-8ed1-b0a7991d3110 req-1fb74761-0180-4270-9c94-2a03851a3a73 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:16:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-aa2641e2-d08c-4435-8ed1-b0a7991d3110 req-1fb74761-0180-4270-9c94-2a03851a3a73 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055318 Apr 14 04:16:57 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 30/92] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6830ee71-c32b-4fc3-bec3-6b58a5780c2b req-d94ee161-2b48-44ef-acfa-cd5ffad3ed57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-plugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6830ee71-c32b-4fc3-bec3-6b58a5780c2b req-d94ee161-2b48-44ef-acfa-cd5ffad3ed57 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6830ee71-c32b-4fc3-bec3-6b58a5780c2b req-d94ee161-2b48-44ef-acfa-cd5ffad3ed57 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6830ee71-c32b-4fc3-bec3-6b58a5780c2b req-d94ee161-2b48-44ef-acfa-cd5ffad3ed57 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-d91adc75-c262-46f9-ac99-2dceac2c46b6 req-49d739ba-dffd-41ce-8bd7-f2a4c2f6463a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d91adc75-c262-46f9-ac99-2dceac2c46b6 req-49d739ba-dffd-41ce-8bd7-f2a4c2f6463a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d91adc75-c262-46f9-ac99-2dceac2c46b6 req-49d739ba-dffd-41ce-8bd7-f2a4c2f6463a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d91adc75-c262-46f9-ac99-2dceac2c46b6 req-49d739ba-dffd-41ce-8bd7-f2a4c2f6463a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-d91adc75-c262-46f9-ac99-2dceac2c46b6 req-49d739ba-dffd-41ce-8bd7-f2a4c2f6463a service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:16:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6830ee71-c32b-4fc3-bec3-6b58a5780c2b req-d94ee161-2b48-44ef-acfa-cd5ffad3ed57 service nova] Creating event network-vif-plugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:16:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6830ee71-c32b-4fc3-bec3-6b58a5780c2b req-d94ee161-2b48-44ef-acfa-cd5ffad3ed57 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099068 Apr 14 04:16:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 34/93] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-2c397b30-725b-46d8-b84c-ca32b1de8609 req-3437ffb9-375e-4f39-a333-820acefb2b24 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}, {"name": "network-changed", "server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:16:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-d91adc75-c262-46f9-ac99-2dceac2c46b6 req-49d739ba-dffd-41ce-8bd7-f2a4c2f6463a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052270 Apr 14 04:16:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 30/94] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:16:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2c397b30-725b-46d8-b84c-ca32b1de8609 req-3437ffb9-375e-4f39-a333-820acefb2b24 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:16:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2c397b30-725b-46d8-b84c-ca32b1de8609 req-3437ffb9-375e-4f39-a333-820acefb2b24 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:16:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2c397b30-725b-46d8-b84c-ca32b1de8609 req-3437ffb9-375e-4f39-a333-820acefb2b24 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:16:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2c397b30-725b-46d8-b84c-ca32b1de8609 req-3437ffb9-375e-4f39-a333-820acefb2b24 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:16:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2c397b30-725b-46d8-b84c-ca32b1de8609 req-3437ffb9-375e-4f39-a333-820acefb2b24 service nova] Creating event network-changed:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:16:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-2c397b30-725b-46d8-b84c-ca32b1de8609 req-3437ffb9-375e-4f39-a333-820acefb2b24 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 350 microversion: 2.1 time: 0.084077 Apr 14 04:16:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 31/95] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:16:59 2023] POST /compute/v2.1/os-server-external-events => generated 350 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:16:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachSCSIVolumeTestJSON-server-1544950554", "imageRef": "f478712d-cb56-468b-a1b1-14aa5eab7104", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "69963625-cff2-4260-908f-82359d8b2f77"}], "security_groups": [{"name": "tempest-securitygroup--1070023573"}], "key_name": "tempest-keypair-2075478387", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:00 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] validate_networks() for [('69963625-cff2-4260-908f-82359d8b2f77', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Getting quotas for project e0e636ba0ee9486f9f48905d886ab547. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Getting quotas for user d1b09bc7a0344ae782d33d3222a8ea88 and project e0e636ba0ee9486f9f48905d886ab547. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:17:01 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f478712d-cb56-468b-a1b1-14aa5eab7104',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:17:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e3076907-3a1c-41e0-ae3e-83882698d70e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 2.281572 Apr 14 04:17:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 35/96] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:16:59 2023] POST /compute/v2.1/servers => generated 404 bytes in 2285 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:17:02 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=10 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-670d8556-3640-40b8-bc6c-ee00b8bffa9a tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-670d8556-3640-40b8-bc6c-ee00b8bffa9a tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:02 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-670d8556-3640-40b8-bc6c-ee00b8bffa9a tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b09bc7a0344ae782d33d3222a8ea88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e636ba0ee9486f9f48905d886ab547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:02 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=33 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-670d8556-3640-40b8-bc6c-ee00b8bffa9a tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4" status: 200 len: 1240 microversion: 2.1 time: 0.337775 Apr 14 04:17:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 31/97] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:02 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 => generated 1240 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-63f80013-44c1-4353-b245-689d62c2d058 req-917cfce3-966e-414b-8587-272056081711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-63f80013-44c1-4353-b245-689d62c2d058 req-917cfce3-966e-414b-8587-272056081711 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-63f80013-44c1-4353-b245-689d62c2d058 req-917cfce3-966e-414b-8587-272056081711 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-63f80013-44c1-4353-b245-689d62c2d058 req-917cfce3-966e-414b-8587-272056081711 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-63f80013-44c1-4353-b245-689d62c2d058 req-917cfce3-966e-414b-8587-272056081711 service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:17:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-63f80013-44c1-4353-b245-689d62c2d058 req-917cfce3-966e-414b-8587-272056081711 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157401 Apr 14 04:17:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 32/98] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-420804238", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "c9babf6f-d879-4cff-b628-f100d9293bff"}], "security_groups": [{"name": "tempest-securitygroup--1794065505"}], "key_name": "tempest-keypair-330344245", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:03 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] validate_networks() for [('c9babf6f-d879-4cff-b628-f100d9293bff', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Getting quotas for project 01cefa66350a4432ad71204b39e953be. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Getting quotas for user 0aeeeae7cbc340daa8cd81c1418794e0 and project 01cefa66350a4432ad71204b39e953be. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:17:04 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:17:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-0cf0cda3-a7cf-4354-9e51-6a8ecc7d721d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.49 time: 1.609992 Apr 14 04:17:04 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 36/99] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 04:17:02 2023] POST /compute/v2.1/servers => generated 404 bytes in 1612 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:17:04 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e0b437eb-b66e-4f7b-b232-f814d761444d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:04 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e0b437eb-b66e-4f7b-b232-f814d761444d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:04 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e0b437eb-b66e-4f7b-b232-f814d761444d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:04 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e0b437eb-b66e-4f7b-b232-f814d761444d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:04 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e0b437eb-b66e-4f7b-b232-f814d761444d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e0b437eb-b66e-4f7b-b232-f814d761444d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 200 len: 1319 microversion: 2.49 time: 0.289654 Apr 14 04:17:04 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 32/100] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:17:04 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 1319 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:17:04 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-af719bcc-9105-43f6-bd79-55c6e2fd7969 req-43c05b80-8877-4c22-b2b2-c19a2f344ef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-af719bcc-9105-43f6-bd79-55c6e2fd7969 req-43c05b80-8877-4c22-b2b2-c19a2f344ef6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-af719bcc-9105-43f6-bd79-55c6e2fd7969 req-43c05b80-8877-4c22-b2b2-c19a2f344ef6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-af719bcc-9105-43f6-bd79-55c6e2fd7969 req-43c05b80-8877-4c22-b2b2-c19a2f344ef6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:04 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=21 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-af719bcc-9105-43f6-bd79-55c6e2fd7969 req-43c05b80-8877-4c22-b2b2-c19a2f344ef6 service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:17:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-af719bcc-9105-43f6-bd79-55c6e2fd7969 req-43c05b80-8877-4c22-b2b2-c19a2f344ef6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116759 Apr 14 04:17:04 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 33/101] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-a9c3c8a1-195b-48a2-b871-3fa09d0a5629 req-49e00a46-01eb-4850-a131-78d2ea502762 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5344b0d-2d73-40c7-8ac3-535396e985a4", "tag": "2d24208b-94ce-4364-86a4-1758c24e9047"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a9c3c8a1-195b-48a2-b871-3fa09d0a5629 req-49e00a46-01eb-4850-a131-78d2ea502762 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a9c3c8a1-195b-48a2-b871-3fa09d0a5629 req-49e00a46-01eb-4850-a131-78d2ea502762 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a9c3c8a1-195b-48a2-b871-3fa09d0a5629 req-49e00a46-01eb-4850-a131-78d2ea502762 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-a9c3c8a1-195b-48a2-b871-3fa09d0a5629 req-49e00a46-01eb-4850-a131-78d2ea502762 service nova] Creating event network-changed:2d24208b-94ce-4364-86a4-1758c24e9047 for instance e5344b0d-2d73-40c7-8ac3-535396e985a4 on user Apr 14 04:17:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-a9c3c8a1-195b-48a2-b871-3fa09d0a5629 req-49e00a46-01eb-4850-a131-78d2ea502762 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067750 Apr 14 04:17:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 37/102] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:07 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a0983b73-b5af-4ff6-927e-bf5fd8c3c9cc tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Action: 'create', calling method: .version_select at 0x7f538bb7b250>, body: {"keypair": {"name": "tempest-keypair-1360289330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFbgdbG+/8WAlmHZQQgAOqS/UONGNW8t82kEvX2AWKVyIPVWzo6LlVeaPM998LCX+uM50LF1wQnPotgqjtWl9nx8bNCNwqqSA4Fxg3g55HZulk97rrGLje8WCx8z8LeJ+Q=="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:07 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-a0983b73-b5af-4ff6-927e-bf5fd8c3c9cc tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Getting quotas for project ffadee5eeb7f4b42ae93e2e2578ef897. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:07 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-a0983b73-b5af-4ff6-927e-bf5fd8c3c9cc tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Getting quotas for user 1da030e7c9e44f9b82f3286378a2ede6 and project ffadee5eeb7f4b42ae93e2e2578ef897. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:07 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a0983b73-b5af-4ff6-927e-bf5fd8c3c9cc tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088224 Apr 14 04:17:07 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 33/103] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:17:07 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-7ad9acef-447d-44e6-8af8-abea81977a44 req-8d5417dd-4d0e-4a3a-bb06-5ae67b543684 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "tag": "60579bc4-de13-48d7-b42d-2b9fc5597e45"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7ad9acef-447d-44e6-8af8-abea81977a44 req-8d5417dd-4d0e-4a3a-bb06-5ae67b543684 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7ad9acef-447d-44e6-8af8-abea81977a44 req-8d5417dd-4d0e-4a3a-bb06-5ae67b543684 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7ad9acef-447d-44e6-8af8-abea81977a44 req-8d5417dd-4d0e-4a3a-bb06-5ae67b543684 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-7ad9acef-447d-44e6-8af8-abea81977a44 req-8d5417dd-4d0e-4a3a-bb06-5ae67b543684 service nova] Creating event network-changed:60579bc4-de13-48d7-b42d-2b9fc5597e45 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:17:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-7ad9acef-447d-44e6-8af8-abea81977a44 req-8d5417dd-4d0e-4a3a-bb06-5ae67b543684 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048532 Apr 14 04:17:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 34/104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeSwap-server-1758802671", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "43bde039-802b-47d6-9194-3fcc8d89149f"}], "security_groups": [{"name": "tempest-securitygroup--1164992552"}], "key_name": "tempest-keypair-1360289330", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:10 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] validate_networks() for [('43bde039-802b-47d6-9194-3fcc8d89149f', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=16 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-29e54fbe-56a3-4de8-8d53-1278002dde35 req-fd92b667-fc20-4bdb-aa66-53762509bc71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5344b0d-2d73-40c7-8ac3-535396e985a4", "name": "network-vif-plugged", "status": "completed", "tag": "2d24208b-94ce-4364-86a4-1758c24e9047"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-29e54fbe-56a3-4de8-8d53-1278002dde35 req-fd92b667-fc20-4bdb-aa66-53762509bc71 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-29e54fbe-56a3-4de8-8d53-1278002dde35 req-fd92b667-fc20-4bdb-aa66-53762509bc71 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-29e54fbe-56a3-4de8-8d53-1278002dde35 req-fd92b667-fc20-4bdb-aa66-53762509bc71 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-29e54fbe-56a3-4de8-8d53-1278002dde35 req-fd92b667-fc20-4bdb-aa66-53762509bc71 service nova] Creating event network-vif-plugged:2d24208b-94ce-4364-86a4-1758c24e9047 for instance e5344b0d-2d73-40c7-8ac3-535396e985a4 on user Apr 14 04:17:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-29e54fbe-56a3-4de8-8d53-1278002dde35 req-fd92b667-fc20-4bdb-aa66-53762509bc71 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072526 Apr 14 04:17:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 34/105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=31 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Getting quotas for project ffadee5eeb7f4b42ae93e2e2578ef897. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Getting quotas for user 1da030e7c9e44f9b82f3286378a2ede6 and project ffadee5eeb7f4b42ae93e2e2578ef897. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:17:11 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 0ff97860-2441-437c-b118-6089c3cc4160] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:11 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4c0535bc-79b9-452e-a3e5-2ef7cc727327 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.075788 Apr 14 04:17:11 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 38/106] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:17:10 2023] POST /compute/v2.1/servers => generated 404 bytes in 1077 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-745601c4-33b6-415d-ae28-933e0c567344 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-745601c4-33b6-415d-ae28-933e0c567344 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:11 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-745601c4-33b6-415d-ae28-933e0c567344 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da030e7c9e44f9b82f3286378a2ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffadee5eeb7f4b42ae93e2e2578ef897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-745601c4-33b6-415d-ae28-933e0c567344 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7" status: 200 len: 1226 microversion: 2.1 time: 0.218331 Apr 14 04:17:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 35/107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:11 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 => generated 1226 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:12 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e422970cd8340bf996a135088094f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280aa55745a749b7baa134334d25c9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a976273b-e8a6-468e-bc3a-fab43eb8d3a8 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160" status: 200 len: 1484 microversion: 2.1 time: 0.381019 Apr 14 04:17:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 35/108] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:11 2023] GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160 => generated 1484 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-5e891da9-cd62-41cc-b4a9-98b35d2b5620 req-760dc850-7864-46e8-a228-2174b5dea0f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-plugged", "status": "completed", "tag": "60579bc4-de13-48d7-b42d-2b9fc5597e45"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5e891da9-cd62-41cc-b4a9-98b35d2b5620 req-760dc850-7864-46e8-a228-2174b5dea0f0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5e891da9-cd62-41cc-b4a9-98b35d2b5620 req-760dc850-7864-46e8-a228-2174b5dea0f0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5e891da9-cd62-41cc-b4a9-98b35d2b5620 req-760dc850-7864-46e8-a228-2174b5dea0f0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5e891da9-cd62-41cc-b4a9-98b35d2b5620 req-760dc850-7864-46e8-a228-2174b5dea0f0 service nova] Creating event network-vif-plugged:60579bc4-de13-48d7-b42d-2b9fc5597e45 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:17:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-5e891da9-cd62-41cc-b4a9-98b35d2b5620 req-760dc850-7864-46e8-a228-2174b5dea0f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037851 Apr 14 04:17:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 39/109] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:13 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-39fb2c73-d4d5-4fc7-9e35-4bc1cfe0d3bc req-c841a8a3-3851-44ab-a90c-3391af63cb76 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5344b0d-2d73-40c7-8ac3-535396e985a4", "name": "network-vif-plugged", "status": "completed", "tag": "2d24208b-94ce-4364-86a4-1758c24e9047"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-39fb2c73-d4d5-4fc7-9e35-4bc1cfe0d3bc req-c841a8a3-3851-44ab-a90c-3391af63cb76 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-39fb2c73-d4d5-4fc7-9e35-4bc1cfe0d3bc req-c841a8a3-3851-44ab-a90c-3391af63cb76 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-39fb2c73-d4d5-4fc7-9e35-4bc1cfe0d3bc req-c841a8a3-3851-44ab-a90c-3391af63cb76 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-39fb2c73-d4d5-4fc7-9e35-4bc1cfe0d3bc req-c841a8a3-3851-44ab-a90c-3391af63cb76 service nova] Creating event network-vif-plugged:2d24208b-94ce-4364-86a4-1758c24e9047 for instance e5344b0d-2d73-40c7-8ac3-535396e985a4 on user Apr 14 04:17:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-39fb2c73-d4d5-4fc7-9e35-4bc1cfe0d3bc req-c841a8a3-3851-44ab-a90c-3391af63cb76 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057071 Apr 14 04:17:13 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 36/110] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=22 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:15 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-a913dbf1-3b68-4b45-b31d-630894ff0441 req-3e4e493a-27ab-4d1b-ae71-1a384d70cf1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-plugged", "status": "completed", "tag": "60579bc4-de13-48d7-b42d-2b9fc5597e45"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a913dbf1-3b68-4b45-b31d-630894ff0441 req-3e4e493a-27ab-4d1b-ae71-1a384d70cf1a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a913dbf1-3b68-4b45-b31d-630894ff0441 req-3e4e493a-27ab-4d1b-ae71-1a384d70cf1a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a913dbf1-3b68-4b45-b31d-630894ff0441 req-3e4e493a-27ab-4d1b-ae71-1a384d70cf1a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-a913dbf1-3b68-4b45-b31d-630894ff0441 req-3e4e493a-27ab-4d1b-ae71-1a384d70cf1a service nova] Creating event network-vif-plugged:60579bc4-de13-48d7-b42d-2b9fc5597e45 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:17:15 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-a913dbf1-3b68-4b45-b31d-630894ff0441 req-3e4e493a-27ab-4d1b-ae71-1a384d70cf1a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050822 Apr 14 04:17:15 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 40/111] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:15 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3cf7b3e4-90bb-4dd6-9ebb-d6d2636c65d1 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 200 len: 1494 microversion: 2.1 time: 0.420797 Apr 14 04:17:15 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 36/112] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:14 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 1494 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-cf61eaee-4c5e-4241-b47a-25c28c9a3df2 req-f8b6e73d-d591-401d-b3d6-2eb72b4f958d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7", "tag": "3f178241-75e2-4e0a-8d92-e647d05ed85e"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cf61eaee-4c5e-4241-b47a-25c28c9a3df2 req-f8b6e73d-d591-401d-b3d6-2eb72b4f958d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cf61eaee-4c5e-4241-b47a-25c28c9a3df2 req-f8b6e73d-d591-401d-b3d6-2eb72b4f958d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cf61eaee-4c5e-4241-b47a-25c28c9a3df2 req-f8b6e73d-d591-401d-b3d6-2eb72b4f958d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-cf61eaee-4c5e-4241-b47a-25c28c9a3df2 req-f8b6e73d-d591-401d-b3d6-2eb72b4f958d service nova] Creating event network-changed:3f178241-75e2-4e0a-8d92-e647d05ed85e for instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 on user Apr 14 04:17:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-cf61eaee-4c5e-4241-b47a-25c28c9a3df2 req-f8b6e73d-d591-401d-b3d6-2eb72b4f958d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043226 Apr 14 04:17:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 37/113] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:15 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-9548a05c-8a2b-4256-94ea-f86fbdb85754 req-d9b7aa95-bf31-407f-8e38-1e9e1a317990 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "3f178241-75e2-4e0a-8d92-e647d05ed85e"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9548a05c-8a2b-4256-94ea-f86fbdb85754 req-d9b7aa95-bf31-407f-8e38-1e9e1a317990 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9548a05c-8a2b-4256-94ea-f86fbdb85754 req-d9b7aa95-bf31-407f-8e38-1e9e1a317990 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9548a05c-8a2b-4256-94ea-f86fbdb85754 req-d9b7aa95-bf31-407f-8e38-1e9e1a317990 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-9548a05c-8a2b-4256-94ea-f86fbdb85754 req-d9b7aa95-bf31-407f-8e38-1e9e1a317990 service nova] Creating event network-vif-plugged:3f178241-75e2-4e0a-8d92-e647d05ed85e for instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 on user Apr 14 04:17:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-9548a05c-8a2b-4256-94ea-f86fbdb85754 req-d9b7aa95-bf31-407f-8e38-1e9e1a317990 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.168358 Apr 14 04:17:19 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 41/114] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:21 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-7ac42c71-1388-46ed-bdd8-28ff0d85a5f2 req-7b4ca8df-2d2a-4c99-9405-9afbcef6f960 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "3f178241-75e2-4e0a-8d92-e647d05ed85e"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7ac42c71-1388-46ed-bdd8-28ff0d85a5f2 req-7b4ca8df-2d2a-4c99-9405-9afbcef6f960 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7ac42c71-1388-46ed-bdd8-28ff0d85a5f2 req-7b4ca8df-2d2a-4c99-9405-9afbcef6f960 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7ac42c71-1388-46ed-bdd8-28ff0d85a5f2 req-7b4ca8df-2d2a-4c99-9405-9afbcef6f960 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-7ac42c71-1388-46ed-bdd8-28ff0d85a5f2 req-7b4ca8df-2d2a-4c99-9405-9afbcef6f960 service nova] Creating event network-vif-plugged:3f178241-75e2-4e0a-8d92-e647d05ed85e for instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 on user Apr 14 04:17:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-7ac42c71-1388-46ed-bdd8-28ff0d85a5f2 req-7b4ca8df-2d2a-4c99-9405-9afbcef6f960 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049184 Apr 14 04:17:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 37/115] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=9 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=5 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:23 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-86a043c2-8131-411b-9e5d-a61c5976696e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1538 microversion: 2.1 time: 0.414488 Apr 14 04:17:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 38/116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:23 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1538 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=5 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=10 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:27 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=20 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:28 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab852bb302f44b1af63083c99ea244c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5e634f187b470085e7bfb3c1cfcbe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-149b5da9-0aae-4ae0-919e-3b2fccfebf6c tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb" status: 200 len: 1489 microversion: 2.1 time: 0.446394 Apr 14 04:17:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 42/117] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:27 2023] GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb => generated 1489 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=17 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:32 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-5731831f-6226-4d8c-bb90-6fe2f1579b51 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1538 microversion: 2.1 time: 0.276556 Apr 14 04:17:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 38/118] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:32 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1538 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=12 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:35 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-26ecfafa-36bb-4201-8608-6fa58680e241 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a" status: 200 len: 1504 microversion: 2.1 time: 0.236710 Apr 14 04:17:35 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 39/119] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:34 2023] GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a => generated 1504 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:17:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b5efbfe1-4c20-4170-a318-844049366a9d tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Action: 'create', calling method: .version_select at 0x7f538bb7bbe0>, body: {"keypair": {"name": "tempest-keypair-475824842", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMCXMmSyKLZyq4lyKnG7khEHSc5g5qMJ/F8GRCn7oNYqNxpgFzEfwdZtFyeQ/uI5EAoHbRxxVEOfw5Nqy2Ndi9EyNPabCR+EMVPuahnBulje1M1+So1WNA2mqeYZNAT8kg=="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:36 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-b5efbfe1-4c20-4170-a318-844049366a9d tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Getting quotas for project 225e61ca983d4f27adc61ad33c81fce4. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:36 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-b5efbfe1-4c20-4170-a318-844049366a9d tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Getting quotas for user b848680106b74275a947f316ce6311fd and project 225e61ca983d4f27adc61ad33c81fce4. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b5efbfe1-4c20-4170-a318-844049366a9d tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.42 time: 0.042087 Apr 14 04:17:36 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 43/120] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 04:17:36 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 43 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-889777707", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "a1bf1e4d-8f7d-47bf-89a9-85f81fe3b428"}, {"port": "8c995dcb-b43b-4bdd-b631-e3b6104d49d0", "tag": "port-1"}, {"port": "c9994009-b14a-4ff4-ac36-f02b0feccfb6", "tag": "port-2"}, {"uuid": "ca386160-6d9c-4824-a9c3-a50508890008", "tag": "net-1"}, {"uuid": "ca386160-6d9c-4824-a9c3-a50508890008"}, {"uuid": "a05db065-8e40-45f0-b7b3-49aa6fa45eed", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a05db065-8e40-45f0-b7b3-49aa6fa45eed", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "31382528-1966-4f19-8a4a-94983a6314c3", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "18016742-a15a-4e85-9fb9-4cbfd819316b", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "c8315093-aba5-4adf-8381-c59806b42282", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--1353312385"}], "key_name": "tempest-keypair-475824842", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:38 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d80d3684045298d895555247174af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bb9ddec81e4f6cbceb6ce7dee9c3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-51757566-2a9f-4abc-a662-217f484523c1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 200 len: 1553 microversion: 2.1 time: 0.147378 Apr 14 04:17:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 39/121] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:37 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:38 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] validate_networks() for [('a1bf1e4d-8f7d-47bf-89a9-85f81fe3b428', None, None, None, None, None), (None, None, '8c995dcb-b43b-4bdd-b631-e3b6104d49d0', None, None, None), (None, None, 'c9994009-b14a-4ff4-ac36-f02b0feccfb6', None, None, None), ('ca386160-6d9c-4824-a9c3-a50508890008', None, None, None, None, None), ('ca386160-6d9c-4824-a9c3-a50508890008', None, None, None, None, None), ('a05db065-8e40-45f0-b7b3-49aa6fa45eed', '10.2.2.100', None, None, None, None), ('a05db065-8e40-45f0-b7b3-49aa6fa45eed', '10.2.2.200', None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Getting quotas for project 225e61ca983d4f27adc61ad33c81fce4. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:40 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Getting quotas for user b848680106b74275a947f316ce6311fd and project 225e61ca983d4f27adc61ad33c81fce4. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:41 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:17:41 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='31382528-1966-4f19-8a4a-94983a6314c3',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='18016742-a15a-4e85-9fb9-4cbfd819316b',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c8315093-aba5-4adf-8381-c59806b42282',volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:17:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-bdd69aae-d460-4b88-b94d-0194c85d9ca9 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.42 time: 3.449871 Apr 14 04:17:41 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 40/122] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 04:17:38 2023] POST /compute/v2.1/servers => generated 404 bytes in 3451 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:17:41 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=5 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-352c93a6-1ad9-4c51-be4d-04c2d6e6b8e1 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:41 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-352c93a6-1ad9-4c51-be4d-04c2d6e6b8e1 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-352c93a6-1ad9-4c51-be4d-04c2d6e6b8e1 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-352c93a6-1ad9-4c51-be4d-04c2d6e6b8e1 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-352c93a6-1ad9-4c51-be4d-04c2d6e6b8e1 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-352c93a6-1ad9-4c51-be4d-04c2d6e6b8e1 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 200 len: 1278 microversion: 2.42 time: 0.068826 Apr 14 04:17:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 44/123] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:17:41 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 1278 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:17:47 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-653ae4f7-4300-4540-93b5-85b7da30fb72 req-d4a1d0c7-bbba-4a4f-8e66-758a487a9cef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "eea29fce-f6e3-4715-9a46-2a638462c6f8"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-653ae4f7-4300-4540-93b5-85b7da30fb72 req-d4a1d0c7-bbba-4a4f-8e66-758a487a9cef service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-653ae4f7-4300-4540-93b5-85b7da30fb72 req-d4a1d0c7-bbba-4a4f-8e66-758a487a9cef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-653ae4f7-4300-4540-93b5-85b7da30fb72 req-d4a1d0c7-bbba-4a4f-8e66-758a487a9cef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:47 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-653ae4f7-4300-4540-93b5-85b7da30fb72 req-d4a1d0c7-bbba-4a4f-8e66-758a487a9cef service nova] Creating event network-changed:eea29fce-f6e3-4715-9a46-2a638462c6f8 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:17:47 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-653ae4f7-4300-4540-93b5-85b7da30fb72 req-d4a1d0c7-bbba-4a4f-8e66-758a487a9cef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037026 Apr 14 04:17:47 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 40/124] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:46 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:49 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-870a5631-2ce1-425e-92ca-d781f868f225 req-4ce0e604-842b-4e58-bf6d-83f77f19f7b9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "8c995dcb-b43b-4bdd-b631-e3b6104d49d0"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-870a5631-2ce1-425e-92ca-d781f868f225 req-4ce0e604-842b-4e58-bf6d-83f77f19f7b9 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-870a5631-2ce1-425e-92ca-d781f868f225 req-4ce0e604-842b-4e58-bf6d-83f77f19f7b9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-870a5631-2ce1-425e-92ca-d781f868f225 req-4ce0e604-842b-4e58-bf6d-83f77f19f7b9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-870a5631-2ce1-425e-92ca-d781f868f225 req-4ce0e604-842b-4e58-bf6d-83f77f19f7b9 service nova] Creating event network-changed:8c995dcb-b43b-4bdd-b631-e3b6104d49d0 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:17:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-870a5631-2ce1-425e-92ca-d781f868f225 req-4ce0e604-842b-4e58-bf6d-83f77f19f7b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031004 Apr 14 04:17:49 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 41/125] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:49 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:51 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-fb4dd4ac-26d2-4734-b8cb-733c8cc206b2 req-9d0cdff7-8391-4dec-8f12-89a1dd7508e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "c9994009-b14a-4ff4-ac36-f02b0feccfb6"}, {"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-fb4dd4ac-26d2-4734-b8cb-733c8cc206b2 req-9d0cdff7-8391-4dec-8f12-89a1dd7508e4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-fb4dd4ac-26d2-4734-b8cb-733c8cc206b2 req-9d0cdff7-8391-4dec-8f12-89a1dd7508e4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-fb4dd4ac-26d2-4734-b8cb-733c8cc206b2 req-9d0cdff7-8391-4dec-8f12-89a1dd7508e4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:51 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-fb4dd4ac-26d2-4734-b8cb-733c8cc206b2 req-9d0cdff7-8391-4dec-8f12-89a1dd7508e4 service nova] Creating event network-changed:c9994009-b14a-4ff4-ac36-f02b0feccfb6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:17:51 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-fb4dd4ac-26d2-4734-b8cb-733c8cc206b2 req-9d0cdff7-8391-4dec-8f12-89a1dd7508e4 service nova] Creating event network-changed:11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:17:51 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-fb4dd4ac-26d2-4734-b8cb-733c8cc206b2 req-9d0cdff7-8391-4dec-8f12-89a1dd7508e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033923 Apr 14 04:17:51 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 45/126] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:51 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:52 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b09bc7a0344ae782d33d3222a8ea88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e636ba0ee9486f9f48905d886ab547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7b12058a-7053-457b-a52c-72cb6901ee9f tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4" status: 200 len: 1550 microversion: 2.1 time: 0.194874 Apr 14 04:17:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 41/127] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:52 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 => generated 1550 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:53 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:53 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "8257c16c-6115-4b67-a739-91cb1d5e8bc6"}, {"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5"}, {"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "512baf47-b5bf-4cf0-8300-f0e0167fc70e"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] Creating event network-changed:8257c16c-6115-4b67-a739-91cb1d5e8bc6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:17:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] Creating event network-changed:07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:17:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] Creating event network-changed:512baf47-b5bf-4cf0-8300-f0e0167fc70e for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:17:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-ec50a640-a83c-49e7-bb88-f2c57d1a2d80 req-36587cc1-8315-4b55-9478-89e66273eb12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.031485 Apr 14 04:17:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 42/128] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:53 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:53 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:17:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-377c4af5-7193-4204-9d78-07beda1dfde8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'create', calling method: .version_select at 0x7f538bb79120>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1599913910", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA++2BXIcEQ2v7bj136wrEst3TLhMf3Pwm5yFI2y5OTUcyHd3G9mX9nGbcm6RmV/qF9Miy1upxS4ewe90Jmk1PeD7f+WKuozsw6VgX059vi7WiBA0frzDuQmMNJN3b4XIg=="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:53 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-377c4af5-7193-4204-9d78-07beda1dfde8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for project 0a60f60717b44f4ba904a949eabfe608. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:53 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-377c4af5-7193-4204-9d78-07beda1dfde8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for user 982f167333954612a51911fc8d6c1ce9 and project 0a60f60717b44f4ba904a949eabfe608. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-377c4af5-7193-4204-9d78-07beda1dfde8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.055508 Apr 14 04:17:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 46/129] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:17:53 2023] POST /compute/v2.1/os-keypairs => generated 403 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-99049874", "imageRef": "2921b7b4-17d1-4c56-9fbc-a30733db1472", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-1599913910", "networks": [{"uuid": "d3a59e6b-aaf6-4acb-a1cb-29f980dfa5a8"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] validate_networks() for [('d3a59e6b-aaf6-4acb-a1cb-29f980dfa5a8', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:53 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for project 0a60f60717b44f4ba904a949eabfe608. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:17:54 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for user 982f167333954612a51911fc8d6c1ce9 and project 0a60f60717b44f4ba904a949eabfe608. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:17:54 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:17:54 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2921b7b4-17d1-4c56-9fbc-a30733db1472',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:17:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1611a0af-5fa4-4f36-9eeb-cfe97e9b2607 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.714771 Apr 14 04:17:54 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 42/130] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:17:53 2023] POST /compute/v2.1/servers => generated 378 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:17:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d5d7d7bd-28f0-4cf7-90ee-ee76849c0111 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:54 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d5d7d7bd-28f0-4cf7-90ee-ee76849c0111 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:54 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d5d7d7bd-28f0-4cf7-90ee-ee76849c0111 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d5d7d7bd-28f0-4cf7-90ee-ee76849c0111 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1251 microversion: 2.1 time: 0.107890 Apr 14 04:17:54 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 43/131] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:17:54 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1251 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:54 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:55 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:55 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:17:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d1ab9b4e-7991-43cd-8ba6-3b6fc5ed694d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 200 len: 1626 microversion: 2.49 time: 0.256554 Apr 14 04:17:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 47/132] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:17:54 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 1626 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 04:17:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-899a93fc-546c-4f6e-85ee-711fa12af6c3 req-af87fc58-dc20-40ee-b1ab-6dd9a5aae1a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-899a93fc-546c-4f6e-85ee-711fa12af6c3 req-af87fc58-dc20-40ee-b1ab-6dd9a5aae1a4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-899a93fc-546c-4f6e-85ee-711fa12af6c3 req-af87fc58-dc20-40ee-b1ab-6dd9a5aae1a4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-899a93fc-546c-4f6e-85ee-711fa12af6c3 req-af87fc58-dc20-40ee-b1ab-6dd9a5aae1a4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-899a93fc-546c-4f6e-85ee-711fa12af6c3 req-af87fc58-dc20-40ee-b1ab-6dd9a5aae1a4 service nova] Creating event network-changed:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:17:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-899a93fc-546c-4f6e-85ee-711fa12af6c3 req-af87fc58-dc20-40ee-b1ab-6dd9a5aae1a4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029827 Apr 14 04:17:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 43/133] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:17:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-1024a532-9bf1-4397-b727-e186647fdbc8 req-e826de5c-3991-4e50-ab0a-49cfb36c9016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-plugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:17:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1024a532-9bf1-4397-b727-e186647fdbc8 req-e826de5c-3991-4e50-ab0a-49cfb36c9016 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:17:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1024a532-9bf1-4397-b727-e186647fdbc8 req-e826de5c-3991-4e50-ab0a-49cfb36c9016 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:17:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1024a532-9bf1-4397-b727-e186647fdbc8 req-e826de5c-3991-4e50-ab0a-49cfb36c9016 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:17:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-1024a532-9bf1-4397-b727-e186647fdbc8 req-e826de5c-3991-4e50-ab0a-49cfb36c9016 service nova] Creating event network-vif-plugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:17:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-1024a532-9bf1-4397-b727-e186647fdbc8 req-e826de5c-3991-4e50-ab0a-49cfb36c9016 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031902 Apr 14 04:17:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 44/134] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:17:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6cb85f51-c5a3-4d60-8f81-1e74fc02b8b4 req-efde8e70-0641-4a69-929f-95dffb9c3a18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-plugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:00 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6cb85f51-c5a3-4d60-8f81-1e74fc02b8b4 req-efde8e70-0641-4a69-929f-95dffb9c3a18 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6cb85f51-c5a3-4d60-8f81-1e74fc02b8b4 req-efde8e70-0641-4a69-929f-95dffb9c3a18 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6cb85f51-c5a3-4d60-8f81-1e74fc02b8b4 req-efde8e70-0641-4a69-929f-95dffb9c3a18 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6cb85f51-c5a3-4d60-8f81-1e74fc02b8b4 req-efde8e70-0641-4a69-929f-95dffb9c3a18 service nova] Creating event network-vif-plugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:18:01 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6cb85f51-c5a3-4d60-8f81-1e74fc02b8b4 req-efde8e70-0641-4a69-929f-95dffb9c3a18 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032249 Apr 14 04:18:01 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 48/135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:02 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da030e7c9e44f9b82f3286378a2ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffadee5eeb7f4b42ae93e2e2578ef897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-dd8cf19b-27fb-42f3-960e-e9fd1508c17b tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7" status: 200 len: 1524 microversion: 2.1 time: 0.140009 Apr 14 04:18:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 44/136] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:02 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 => generated 1524 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:05 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-c53af1c0-d59b-431e-a4b6-acd25d1f5812 req-38090454-1880-488a-be9c-1e47f41186d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "eea29fce-f6e3-4715-9a46-2a638462c6f8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:05 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c53af1c0-d59b-431e-a4b6-acd25d1f5812 req-38090454-1880-488a-be9c-1e47f41186d1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c53af1c0-d59b-431e-a4b6-acd25d1f5812 req-38090454-1880-488a-be9c-1e47f41186d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c53af1c0-d59b-431e-a4b6-acd25d1f5812 req-38090454-1880-488a-be9c-1e47f41186d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:05 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=15 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-c53af1c0-d59b-431e-a4b6-acd25d1f5812 req-38090454-1880-488a-be9c-1e47f41186d1 service nova] Creating event network-vif-plugged:eea29fce-f6e3-4715-9a46-2a638462c6f8 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-c53af1c0-d59b-431e-a4b6-acd25d1f5812 req-38090454-1880-488a-be9c-1e47f41186d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057010 Apr 14 04:18:05 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 45/137] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:06 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:06 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-710ddf74-9924-4770-842d-6f99133c1ded req-a81f3127-a08d-4ec7-9a54-64dadbed7fb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "8c995dcb-b43b-4bdd-b631-e3b6104d49d0"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-710ddf74-9924-4770-842d-6f99133c1ded req-a81f3127-a08d-4ec7-9a54-64dadbed7fb1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-710ddf74-9924-4770-842d-6f99133c1ded req-a81f3127-a08d-4ec7-9a54-64dadbed7fb1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-710ddf74-9924-4770-842d-6f99133c1ded req-a81f3127-a08d-4ec7-9a54-64dadbed7fb1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-710ddf74-9924-4770-842d-6f99133c1ded req-a81f3127-a08d-4ec7-9a54-64dadbed7fb1 service nova] Creating event network-vif-plugged:8c995dcb-b43b-4bdd-b631-e3b6104d49d0 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-710ddf74-9924-4770-842d-6f99133c1ded req-a81f3127-a08d-4ec7-9a54-64dadbed7fb1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034204 Apr 14 04:18:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 49/138] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "eea29fce-f6e3-4715-9a46-2a638462c6f8"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "8257c16c-6115-4b67-a739-91cb1d5e8bc6"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "8257c16c-6115-4b67-a739-91cb1d5e8bc6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:07 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=31 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Creating event network-vif-plugged:eea29fce-f6e3-4715-9a46-2a638462c6f8 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Creating event network-vif-plugged:11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Creating event network-vif-plugged:11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Creating event network-vif-plugged:8257c16c-6115-4b67-a739-91cb1d5e8bc6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] Creating event network-vif-plugged:8257c16c-6115-4b67-a739-91cb1d5e8bc6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-5214217c-f508-4f94-9d3e-f01b3adcac45 req-4f0bfc3a-9383-45be-a57f-179507cc1b31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.102916 Apr 14 04:18:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 45/139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:07 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "8c995dcb-b43b-4bdd-b631-e3b6104d49d0"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "c9994009-b14a-4ff4-ac36-f02b0feccfb6"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "c9994009-b14a-4ff4-ac36-f02b0feccfb6"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "512baf47-b5bf-4cf0-8300-f0e0167fc70e"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Creating event network-vif-plugged:8c995dcb-b43b-4bdd-b631-e3b6104d49d0 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Creating event network-vif-plugged:c9994009-b14a-4ff4-ac36-f02b0feccfb6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Creating event network-vif-plugged:c9994009-b14a-4ff4-ac36-f02b0feccfb6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Creating event network-vif-plugged:07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Creating event network-vif-plugged:07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] Creating event network-vif-plugged:512baf47-b5bf-4cf0-8300-f0e0167fc70e for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-5e1774a6-6ed7-4e79-b5f7-a3cd32ba837a req-4f433a41-25e1-4024-b82f-b1b45f0538e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1038 microversion: 2.1 time: 0.038078 Apr 14 04:18:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 46/140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:08 2023] POST /compute/v2.1/os-server-external-events => generated 1038 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-c67771ea-f4c9-46f7-a711-3a3f862d429e req-04885799-c5ef-4646-83df-bfd29c076639 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "512baf47-b5bf-4cf0-8300-f0e0167fc70e"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c67771ea-f4c9-46f7-a711-3a3f862d429e req-04885799-c5ef-4646-83df-bfd29c076639 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c67771ea-f4c9-46f7-a711-3a3f862d429e req-04885799-c5ef-4646-83df-bfd29c076639 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c67771ea-f4c9-46f7-a711-3a3f862d429e req-04885799-c5ef-4646-83df-bfd29c076639 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-c67771ea-f4c9-46f7-a711-3a3f862d429e req-04885799-c5ef-4646-83df-bfd29c076639 service nova] Creating event network-vif-plugged:512baf47-b5bf-4cf0-8300-f0e0167fc70e for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:18:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-c67771ea-f4c9-46f7-a711-3a3f862d429e req-04885799-c5ef-4646-83df-bfd29c076639 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040262 Apr 14 04:18:10 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 50/141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 0ff97860-2441-437c-b118-6089c3cc4160] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:12 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 0ff97860-2441-437c-b118-6089c3cc4160] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:18:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-25042ad5-ce9e-4629-9bf2-ec804a898542 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160" status: 204 len: 0 microversion: 2.1 time: 0.210491 Apr 14 04:18:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 46/142] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:18:12 2023] DELETE /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 0ff97860-2441-437c-b118-6089c3cc4160] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:12 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e422970cd8340bf996a135088094f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280aa55745a749b7baa134334d25c9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f96a4099-8534-47a7-a0c3-cac6bd718b57 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160" status: 200 len: 1490 microversion: 2.1 time: 0.202215 Apr 14 04:18:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 47/143] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:12 2023] GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160 => generated 1490 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-573647d7-3dd6-431d-9a28-3bdfb4aff20c req-8765b5cd-9d2b-407f-a254-e9c88fa4513f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff97860-2441-437c-b118-6089c3cc4160", "name": "network-vif-unplugged", "status": "completed", "tag": "22212b8b-6656-4d88-ad5c-e0d8f657062f"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-573647d7-3dd6-431d-9a28-3bdfb4aff20c req-8765b5cd-9d2b-407f-a254-e9c88fa4513f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-573647d7-3dd6-431d-9a28-3bdfb4aff20c req-8765b5cd-9d2b-407f-a254-e9c88fa4513f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-573647d7-3dd6-431d-9a28-3bdfb4aff20c req-8765b5cd-9d2b-407f-a254-e9c88fa4513f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:13 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=15 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-573647d7-3dd6-431d-9a28-3bdfb4aff20c req-8765b5cd-9d2b-407f-a254-e9c88fa4513f service nova] Creating event network-vif-unplugged:22212b8b-6656-4d88-ad5c-e0d8f657062f for instance 0ff97860-2441-437c-b118-6089c3cc4160 on user Apr 14 04:18:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-573647d7-3dd6-431d-9a28-3bdfb4aff20c req-8765b5cd-9d2b-407f-a254-e9c88fa4513f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036560 Apr 14 04:18:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 51/144] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:13 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f4e59366-b2f6-457b-a7fe-308e961e7fc0 req-c1b5bfc5-5c26-44aa-988e-430f9808fe3b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff97860-2441-437c-b118-6089c3cc4160", "name": "network-vif-deleted", "tag": "22212b8b-6656-4d88-ad5c-e0d8f657062f"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f4e59366-b2f6-457b-a7fe-308e961e7fc0 req-c1b5bfc5-5c26-44aa-988e-430f9808fe3b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f4e59366-b2f6-457b-a7fe-308e961e7fc0 req-c1b5bfc5-5c26-44aa-988e-430f9808fe3b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f4e59366-b2f6-457b-a7fe-308e961e7fc0 req-c1b5bfc5-5c26-44aa-988e-430f9808fe3b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f4e59366-b2f6-457b-a7fe-308e961e7fc0 req-c1b5bfc5-5c26-44aa-988e-430f9808fe3b service nova] Creating event network-vif-deleted:22212b8b-6656-4d88-ad5c-e0d8f657062f for instance 0ff97860-2441-437c-b118-6089c3cc4160 on user Apr 14 04:18:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f4e59366-b2f6-457b-a7fe-308e961e7fc0 req-c1b5bfc5-5c26-44aa-988e-430f9808fe3b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039403 Apr 14 04:18:14 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 47/145] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:18:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-ac76bf17-7864-45d2-ad83-545b40554be6 req-95bb3bb9-8c76-4d22-a3b9-b99922448715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0ff97860-2441-437c-b118-6089c3cc4160", "name": "network-vif-plugged", "status": "completed", "tag": "22212b8b-6656-4d88-ad5c-e0d8f657062f"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ac76bf17-7864-45d2-ad83-545b40554be6 req-95bb3bb9-8c76-4d22-a3b9-b99922448715 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ac76bf17-7864-45d2-ad83-545b40554be6 req-95bb3bb9-8c76-4d22-a3b9-b99922448715 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ac76bf17-7864-45d2-ad83-545b40554be6 req-95bb3bb9-8c76-4d22-a3b9-b99922448715 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-ac76bf17-7864-45d2-ad83-545b40554be6 req-95bb3bb9-8c76-4d22-a3b9-b99922448715 service nova] Creating event network-vif-plugged:22212b8b-6656-4d88-ad5c-e0d8f657062f for instance 0ff97860-2441-437c-b118-6089c3cc4160 on user Apr 14 04:18:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-ac76bf17-7864-45d2-ad83-545b40554be6 req-95bb3bb9-8c76-4d22-a3b9-b99922448715 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029086 Apr 14 04:18:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 48/146] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-1774642635", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "a462dbfb-12e1-48c7-a797-87823269af2a"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] validate_networks() for [('a462dbfb-12e1-48c7-a797-87823269af2a', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Getting quotas for project bae0fb4af555422a847620627dffeae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Getting quotas for user ea68fb139b004f748cf1bcfb8d675a2e and project bae0fb4af555422a847620627dffeae8. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:18:15 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:18:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e906d53a-a008-41bb-816d-71c21c7af2de tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.512650 Apr 14 04:18:16 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 52/147] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:18:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 516 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:18:16 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-18c40bc3-5a2e-40d7-9e5e-3c1a254fa1aa tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:16 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-18c40bc3-5a2e-40d7-9e5e-3c1a254fa1aa tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:16 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-18c40bc3-5a2e-40d7-9e5e-3c1a254fa1aa tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-18c40bc3-5a2e-40d7-9e5e-3c1a254fa1aa tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964" status: 200 len: 1211 microversion: 2.1 time: 0.091563 Apr 14 04:18:16 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 48/148] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:16 2023] GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-0a7f9130-472a-4acd-9c2a-35e8b0679851 req-5f22ed02-b7a8-4f5c-86e2-1bcee8552b38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "59e547de-a74b-4ccd-90de-e7b61cba6964", "tag": "de9378d0-c63f-48c3-9a25-e7d82b8c0f99"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0a7f9130-472a-4acd-9c2a-35e8b0679851 req-5f22ed02-b7a8-4f5c-86e2-1bcee8552b38 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0a7f9130-472a-4acd-9c2a-35e8b0679851 req-5f22ed02-b7a8-4f5c-86e2-1bcee8552b38 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0a7f9130-472a-4acd-9c2a-35e8b0679851 req-5f22ed02-b7a8-4f5c-86e2-1bcee8552b38 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-0a7f9130-472a-4acd-9c2a-35e8b0679851 req-5f22ed02-b7a8-4f5c-86e2-1bcee8552b38 service nova] Creating event network-changed:de9378d0-c63f-48c3-9a25-e7d82b8c0f99 for instance 59e547de-a74b-4ccd-90de-e7b61cba6964 on user Apr 14 04:18:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-0a7f9130-472a-4acd-9c2a-35e8b0679851 req-5f22ed02-b7a8-4f5c-86e2-1bcee8552b38 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028318 Apr 14 04:18:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 49/149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-52ea88b2-8b6a-45ea-a06c-21ba91411c15 req-3ea586d9-74e9-48ad-a720-cade36b32932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e547de-a74b-4ccd-90de-e7b61cba6964", "name": "network-vif-plugged", "status": "completed", "tag": "de9378d0-c63f-48c3-9a25-e7d82b8c0f99"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-52ea88b2-8b6a-45ea-a06c-21ba91411c15 req-3ea586d9-74e9-48ad-a720-cade36b32932 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-52ea88b2-8b6a-45ea-a06c-21ba91411c15 req-3ea586d9-74e9-48ad-a720-cade36b32932 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-52ea88b2-8b6a-45ea-a06c-21ba91411c15 req-3ea586d9-74e9-48ad-a720-cade36b32932 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-52ea88b2-8b6a-45ea-a06c-21ba91411c15 req-3ea586d9-74e9-48ad-a720-cade36b32932 service nova] Creating event network-vif-plugged:de9378d0-c63f-48c3-9a25-e7d82b8c0f99 for instance 59e547de-a74b-4ccd-90de-e7b61cba6964 on user Apr 14 04:18:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-52ea88b2-8b6a-45ea-a06c-21ba91411c15 req-3ea586d9-74e9-48ad-a720-cade36b32932 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034140 Apr 14 04:18:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 53/150] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-ac04d7d5-5723-47d9-b51c-07b1eea2250b req-e73e43ea-42d9-46ac-a278-bbc3ceb8e527 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e547de-a74b-4ccd-90de-e7b61cba6964", "name": "network-vif-plugged", "status": "completed", "tag": "de9378d0-c63f-48c3-9a25-e7d82b8c0f99"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ac04d7d5-5723-47d9-b51c-07b1eea2250b req-e73e43ea-42d9-46ac-a278-bbc3ceb8e527 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ac04d7d5-5723-47d9-b51c-07b1eea2250b req-e73e43ea-42d9-46ac-a278-bbc3ceb8e527 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ac04d7d5-5723-47d9-b51c-07b1eea2250b req-e73e43ea-42d9-46ac-a278-bbc3ceb8e527 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-ac04d7d5-5723-47d9-b51c-07b1eea2250b req-e73e43ea-42d9-46ac-a278-bbc3ceb8e527 service nova] Creating event network-vif-plugged:de9378d0-c63f-48c3-9a25-e7d82b8c0f99 for instance 59e547de-a74b-4ccd-90de-e7b61cba6964 on user Apr 14 04:18:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-ac04d7d5-5723-47d9-b51c-07b1eea2250b req-e73e43ea-42d9-46ac-a278-bbc3ceb8e527 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033736 Apr 14 04:18:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 49/151] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a051a853-0aee-4e84-af51-13ffedfb56fa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.149497 Apr 14 04:18:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 50/152] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:18:23 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-interface => generated 283 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-bf26deef-253e-402e-967b-01cc86417aaf req-301f1ff6-3e6b-4998-9c57-453c7a75cb31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bf26deef-253e-402e-967b-01cc86417aaf req-301f1ff6-3e6b-4998-9c57-453c7a75cb31 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bf26deef-253e-402e-967b-01cc86417aaf req-301f1ff6-3e6b-4998-9c57-453c7a75cb31 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bf26deef-253e-402e-967b-01cc86417aaf req-301f1ff6-3e6b-4998-9c57-453c7a75cb31 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-bf26deef-253e-402e-967b-01cc86417aaf req-301f1ff6-3e6b-4998-9c57-453c7a75cb31 service nova] Creating event network-changed:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:18:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-bf26deef-253e-402e-967b-01cc86417aaf req-301f1ff6-3e6b-4998-9c57-453c7a75cb31 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039063 Apr 14 04:18:25 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 54/153] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-68b3f7ef-e50e-41c2-b177-ddf8f82e8cdc tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/ips" status: 200 len: 104 microversion: 2.1 time: 0.045838 Apr 14 04:18:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 50/154] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:18:25 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/ips => generated 104 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b7e94002-3eeb-442d-b224-ef83dacfa5a4"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0f7c0f4a-1f73-4e30-9810-e25252fba8f7 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.876102 Apr 14 04:18:29 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 51/155] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:18:28 2023] POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-volume_attachments => generated 194 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09a4582c-404d-4225-baf5-59b74e42325d"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-02b363a5-ff13-4502-8b19-110d6817aab6 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.482814 Apr 14 04:18:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 55/156] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:18:30 2023] POST /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb/os-volume_attachments => generated 194 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:32 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:32 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:32 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-473b7632-b5df-4892-aa54-b7015209a641 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 200 len: 2827 microversion: 2.42 time: 0.626523 Apr 14 04:18:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 51/157] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:18:31 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 2827 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:33 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5b271eab-8ad5-44e8-9b2c-6e13e00eedff tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.188354 Apr 14 04:18:33 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 52/158] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:18:32 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-interface => generated 283 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-77a54ad6-a303-4c44-bb6e-b81763dda202 req-54190368-4b61-4f19-bd10-5a7949900589 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-77a54ad6-a303-4c44-bb6e-b81763dda202 req-54190368-4b61-4f19-bd10-5a7949900589 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-77a54ad6-a303-4c44-bb6e-b81763dda202 req-54190368-4b61-4f19-bd10-5a7949900589 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-77a54ad6-a303-4c44-bb6e-b81763dda202 req-54190368-4b61-4f19-bd10-5a7949900589 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lazy-loading 'flavor' on Instance uuid 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:18:35 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-77a54ad6-a303-4c44-bb6e-b81763dda202 req-54190368-4b61-4f19-bd10-5a7949900589 service nova] Creating event network-changed:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:18:35 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-77a54ad6-a303-4c44-bb6e-b81763dda202 req-54190368-4b61-4f19-bd10-5a7949900589 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041456 Apr 14 04:18:35 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 52/159] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-bb12431b-80aa-4a55-8082-6ca0da9194ea tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a/action" status: 200 len: 32 microversion: 2.1 time: 0.222874 Apr 14 04:18:35 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 56/160] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:18:35 2023] POST /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a/action => generated 32 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5c3dc8e5-ccf6-4da3-9b9e-401b6bcbc37d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1538 microversion: 2.1 time: 0.342435 Apr 14 04:18:35 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 53/161] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:35 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1538 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:35 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:35 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-9271cd67-164f-4553-aa4c-58dc6b9da9b7 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a" status: 200 len: 1510 microversion: 2.1 time: 0.310488 Apr 14 04:18:35 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 53/162] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:35 2023] GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a => generated 1510 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:35 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:35 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-14207709-3819-4226-aeb0-347e51dfcc14 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1538 microversion: 2.1 time: 0.155784 Apr 14 04:18:35 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 57/163] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:35 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1538 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:36 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-1e6bb2e6-de8f-4768-8c5e-b4ec0045d035 req-6392b79d-b8b8-4c49-b3dc-fb5c4c262f4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-unplugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:36 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=18 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1e6bb2e6-de8f-4768-8c5e-b4ec0045d035 req-6392b79d-b8b8-4c49-b3dc-fb5c4c262f4d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1e6bb2e6-de8f-4768-8c5e-b4ec0045d035 req-6392b79d-b8b8-4c49-b3dc-fb5c4c262f4d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1e6bb2e6-de8f-4768-8c5e-b4ec0045d035 req-6392b79d-b8b8-4c49-b3dc-fb5c4c262f4d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:36 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:36 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-1e6bb2e6-de8f-4768-8c5e-b4ec0045d035 req-6392b79d-b8b8-4c49-b3dc-fb5c4c262f4d service nova] Creating event network-vif-unplugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:18:36 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-1e6bb2e6-de8f-4768-8c5e-b4ec0045d035 req-6392b79d-b8b8-4c49-b3dc-fb5c4c262f4d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033909 Apr 14 04:18:36 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 54/164] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:36 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6f5cc6dd-c92a-4bfd-b88a-4b60945f6333 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6f5cc6dd-c92a-4bfd-b88a-4b60945f6333 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6f5cc6dd-c92a-4bfd-b88a-4b60945f6333 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6f5cc6dd-c92a-4bfd-b88a-4b60945f6333 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:36 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6f5cc6dd-c92a-4bfd-b88a-4b60945f6333 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Going to try to stop instance {{(pid=61595) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 04:18:36 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6f5cc6dd-c92a-4bfd-b88a-4b60945f6333 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action" status: 202 len: 0 microversion: 2.1 time: 0.117667 Apr 14 04:18:36 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 54/165] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:18:36 2023] POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:36 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d0bfaa71-2f63-4046-a641-c4f533bbbb04 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1713 microversion: 2.1 time: 0.174540 Apr 14 04:18:36 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 58/166] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:36 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1713 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-35e400d6-5bdc-4a29-9f5d-af36f3665bac req-39232ac8-81ce-4364-9643-9362207bf065 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-unplugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-35e400d6-5bdc-4a29-9f5d-af36f3665bac req-39232ac8-81ce-4364-9643-9362207bf065 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-35e400d6-5bdc-4a29-9f5d-af36f3665bac req-39232ac8-81ce-4364-9643-9362207bf065 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-35e400d6-5bdc-4a29-9f5d-af36f3665bac req-39232ac8-81ce-4364-9643-9362207bf065 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-35e400d6-5bdc-4a29-9f5d-af36f3665bac req-39232ac8-81ce-4364-9643-9362207bf065 service nova] Creating event network-vif-unplugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:18:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-35e400d6-5bdc-4a29-9f5d-af36f3665bac req-39232ac8-81ce-4364-9643-9362207bf065 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035430 Apr 14 04:18:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 55/167] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:37 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:38 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4b89a314-8c5f-4cd8-aab3-7fd177296a56 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.156979 Apr 14 04:18:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 55/168] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:18:38 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-interface => generated 282 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:38 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-0027fd09-e0fd-473b-820c-546442d0d342 req-bb0229d5-ca3c-4259-ba29-167b98956877 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-plugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0027fd09-e0fd-473b-820c-546442d0d342 req-bb0229d5-ca3c-4259-ba29-167b98956877 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0027fd09-e0fd-473b-820c-546442d0d342 req-bb0229d5-ca3c-4259-ba29-167b98956877 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0027fd09-e0fd-473b-820c-546442d0d342 req-bb0229d5-ca3c-4259-ba29-167b98956877 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0027fd09-e0fd-473b-820c-546442d0d342 req-bb0229d5-ca3c-4259-ba29-167b98956877 service nova] Creating event network-vif-plugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:18:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-0027fd09-e0fd-473b-820c-546442d0d342 req-bb0229d5-ca3c-4259-ba29-167b98956877 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058495 Apr 14 04:18:38 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 59/169] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:38 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:18:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-895a79f1-1033-4bb2-b419-a92316f9bcf4 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb" status: 204 len: 0 microversion: 2.1 time: 0.135210 Apr 14 04:18:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 56/170] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:18:38 2023] DELETE /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}, {"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}, {"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}, {"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-unplugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}, {"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:39 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fab852bb302f44b1af63083c99ea244c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce5e634f187b470085e7bfb3c1cfcbe7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f2efe2aa-4a4d-4b35-b9eb-ef871c9a195e tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb" status: 200 len: 1541 microversion: 2.1 time: 0.192099 Apr 14 04:18:39 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 56/171] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:39 2023] GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb => generated 1541 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:18:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:18:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:18:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Creating event network-vif-unplugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:18:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:18:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-5f7881b9-65c3-4e3f-b0ef-1a5c13110339 req-75573994-a254-472f-b52b-f204c2166d79 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.057923 Apr 14 04:18:39 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 60/172] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:39 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerStableDeviceRescueTest-image-2048112536"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37e27b4-0813-4df9-ac66-1516334c12cb", "name": "network-vif-unplugged", "status": "completed", "tag": "2a342575-05e3-4179-a370-6d39ac4f815d"}, {"name": "network-changed", "server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"server_uuid": "e37e27b4-0813-4df9-ac66-1516334c12cb", "name": "network-vif-plugged", "status": "completed", "tag": "2a342575-05e3-4179-a370-6d39ac4f815d"}, {"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-plugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Creating event network-vif-unplugged:2a342575-05e3-4179-a370-6d39ac4f815d for instance e37e27b4-0813-4df9-ac66-1516334c12cb on user Apr 14 04:18:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Creating event network-changed:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:18:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Creating event network-vif-plugged:2a342575-05e3-4179-a370-6d39ac4f815d for instance e37e27b4-0813-4df9-ac66-1516334c12cb on user Apr 14 04:18:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] Creating event network-vif-plugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:18:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-5519f5f3-9f4a-4247-85ea-d9c4b41f00d3 req-5ea51441-f92c-43a5-8c13-5bce4ecfbaae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 694 microversion: 2.1 time: 0.044659 Apr 14 04:18:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 57/173] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:40 2023] POST /compute/v2.1/os-server-external-events => generated 694 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:18:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-639e55d6-044f-49ee-bcfb-b7e30e9e409e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/action" status: 202 len: 0 microversion: 2.1 time: 0.967420 Apr 14 04:18:41 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 57/174] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:18:40 2023] POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/action => generated 0 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 04:18:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c9ae6a84-c950-4dd8-bd57-785399d12df7 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '.version_select at 0x7f538b117be0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c9ae6a84-c950-4dd8-bd57-785399d12df7 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8" status: 200 len: 1611 microversion: 2.1 time: 0.057883 Apr 14 04:18:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 61/175] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 04:18:41 2023] GET /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8 => generated 1611 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:41 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-e47cffa9-c8b4-4cb5-8cb1-f2a0c85cf494 req-d4eb6eaa-81f4-4352-8e4e-c335b8aa4d9c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e37e27b4-0813-4df9-ac66-1516334c12cb", "name": "network-vif-deleted", "tag": "2a342575-05e3-4179-a370-6d39ac4f815d"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e47cffa9-c8b4-4cb5-8cb1-f2a0c85cf494 req-d4eb6eaa-81f4-4352-8e4e-c335b8aa4d9c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e47cffa9-c8b4-4cb5-8cb1-f2a0c85cf494 req-d4eb6eaa-81f4-4352-8e4e-c335b8aa4d9c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e47cffa9-c8b4-4cb5-8cb1-f2a0c85cf494 req-d4eb6eaa-81f4-4352-8e4e-c335b8aa4d9c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e47cffa9-c8b4-4cb5-8cb1-f2a0c85cf494 req-d4eb6eaa-81f4-4352-8e4e-c335b8aa4d9c service nova] Creating event network-vif-deleted:2a342575-05e3-4179-a370-6d39ac4f815d for instance e37e27b4-0813-4df9-ac66-1516334c12cb on user Apr 14 04:18:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-e47cffa9-c8b4-4cb5-8cb1-f2a0c85cf494 req-d4eb6eaa-81f4-4352-8e4e-c335b8aa4d9c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027420 Apr 14 04:18:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 58/176] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-2a07b89b-6e7a-43f1-b2fb-5eeddcaf58d2 req-c4ce8fbe-122c-4884-a5a1-804b5c665f2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-plugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2a07b89b-6e7a-43f1-b2fb-5eeddcaf58d2 req-c4ce8fbe-122c-4884-a5a1-804b5c665f2e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2a07b89b-6e7a-43f1-b2fb-5eeddcaf58d2 req-c4ce8fbe-122c-4884-a5a1-804b5c665f2e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2a07b89b-6e7a-43f1-b2fb-5eeddcaf58d2 req-c4ce8fbe-122c-4884-a5a1-804b5c665f2e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2a07b89b-6e7a-43f1-b2fb-5eeddcaf58d2 req-c4ce8fbe-122c-4884-a5a1-804b5c665f2e service nova] Creating event network-vif-plugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:18:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-2a07b89b-6e7a-43f1-b2fb-5eeddcaf58d2 req-c4ce8fbe-122c-4884-a5a1-804b5c665f2e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041644 Apr 14 04:18:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 58/177] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:44 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:44 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7d3486aa-17c6-4198-b435-ae7120c4325d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1533 microversion: 2.1 time: 0.188627 Apr 14 04:18:44 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 62/178] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:18:44 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1533 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=7 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=13 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2e3d1689-e455-4f1e-a000-924879163cbb tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.102326 Apr 14 04:18:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 59/179] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:18:52 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-interface => generated 283 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:53 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:53 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-40008615-5009-4c67-a4c0-b584ce046145 req-a8ad2d47-c68e-4739-a482-852b482f599f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5344b0d-2d73-40c7-8ac3-535396e985a4", "tag": "2d24208b-94ce-4364-86a4-1758c24e9047"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-40008615-5009-4c67-a4c0-b584ce046145 req-a8ad2d47-c68e-4739-a482-852b482f599f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-40008615-5009-4c67-a4c0-b584ce046145 req-a8ad2d47-c68e-4739-a482-852b482f599f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-40008615-5009-4c67-a4c0-b584ce046145 req-a8ad2d47-c68e-4739-a482-852b482f599f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-40008615-5009-4c67-a4c0-b584ce046145 req-a8ad2d47-c68e-4739-a482-852b482f599f service nova] Creating event network-changed:2d24208b-94ce-4364-86a4-1758c24e9047 for instance e5344b0d-2d73-40c7-8ac3-535396e985a4 on user Apr 14 04:18:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-40008615-5009-4c67-a4c0-b584ce046145 req-a8ad2d47-c68e-4739-a482-852b482f599f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039318 Apr 14 04:18:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 59/180] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=11 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3be9b029-4be3-47b3-a1b3-769484e9df29 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-interface" status: 200 len: 282 microversion: 2.49 time: 0.119813 Apr 14 04:18:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 63/181] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 04:18:55 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-interface => generated 282 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c5e5b34-a82b-4011-88cb-968010ef59f9"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-293a5fff-5f73-4e84-b67f-163bb04363bf req-2b12f65f-b4eb-4172-b040-340e6ebfb97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "tag": "60579bc4-de13-48d7-b42d-2b9fc5597e45"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-293a5fff-5f73-4e84-b67f-163bb04363bf req-2b12f65f-b4eb-4172-b040-340e6ebfb97f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-293a5fff-5f73-4e84-b67f-163bb04363bf req-2b12f65f-b4eb-4172-b040-340e6ebfb97f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-293a5fff-5f73-4e84-b67f-163bb04363bf req-2b12f65f-b4eb-4172-b040-340e6ebfb97f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-293a5fff-5f73-4e84-b67f-163bb04363bf req-2b12f65f-b4eb-4172-b040-340e6ebfb97f service nova] Creating event network-changed:60579bc4-de13-48d7-b42d-2b9fc5597e45 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:18:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-293a5fff-5f73-4e84-b67f-163bb04363bf req-2b12f65f-b4eb-4172-b040-340e6ebfb97f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028225 Apr 14 04:18:56 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 60/182] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:56 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:56 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:18:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e24daa45-9cf8-47e3-8b4a-588ce0f55b4f tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 200 len: 1626 microversion: 2.49 time: 0.169769 Apr 14 04:18:56 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 64/183] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:18:56 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 1626 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Action: 'create', calling method: >, body: {"interfaceAttachment": {"net_id": "d28017dc-3976-4caa-a881-077e38a8b0c7", "tag": "nic-tag"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3cc4c0e3-9d88-4f9b-bf43-f53e51b73186 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305221 Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 60/184] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:18:56 2023] POST /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-ae89b9bf-adb0-470f-9420-adb480035120 req-33a7756c-1154-412f-b122-f613dbc10a0c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "tag": "25048f42-cfe5-48d1-8620-ac6ac6aa9b82"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ae89b9bf-adb0-470f-9420-adb480035120 req-33a7756c-1154-412f-b122-f613dbc10a0c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ae89b9bf-adb0-470f-9420-adb480035120 req-33a7756c-1154-412f-b122-f613dbc10a0c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ae89b9bf-adb0-470f-9420-adb480035120 req-33a7756c-1154-412f-b122-f613dbc10a0c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ae89b9bf-adb0-470f-9420-adb480035120 req-33a7756c-1154-412f-b122-f613dbc10a0c service nova] Creating event network-changed:25048f42-cfe5-48d1-8620-ac6ac6aa9b82 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:18:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-ae89b9bf-adb0-470f-9420-adb480035120 req-33a7756c-1154-412f-b122-f613dbc10a0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035955 Apr 14 04:18:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 65/185] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-2ef0f6d7-5fc5-4077-ad6a-09a142a5a34f req-6f5e126a-acaf-4395-97d2-97045cc95a9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-plugged", "status": "completed", "tag": "25048f42-cfe5-48d1-8620-ac6ac6aa9b82"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2ef0f6d7-5fc5-4077-ad6a-09a142a5a34f req-6f5e126a-acaf-4395-97d2-97045cc95a9b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2ef0f6d7-5fc5-4077-ad6a-09a142a5a34f req-6f5e126a-acaf-4395-97d2-97045cc95a9b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2ef0f6d7-5fc5-4077-ad6a-09a142a5a34f req-6f5e126a-acaf-4395-97d2-97045cc95a9b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2ef0f6d7-5fc5-4077-ad6a-09a142a5a34f req-6f5e126a-acaf-4395-97d2-97045cc95a9b service nova] Creating event network-vif-plugged:25048f42-cfe5-48d1-8620-ac6ac6aa9b82 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:18:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-2ef0f6d7-5fc5-4077-ad6a-09a142a5a34f req-6f5e126a-acaf-4395-97d2-97045cc95a9b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035232 Apr 14 04:18:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 61/186] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:18:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:18:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-6ef74e9c-4d36-4200-be89-d939e4e68280 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-interface" status: 200 len: 283 microversion: 2.49 time: 3.441660 Apr 14 04:18:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 61/187] 10.0.0.210 () {66 vars in 1414 bytes} [Fri Apr 14 04:18:56 2023] POST /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-interface => generated 283 bytes in 3443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "80a9f7e6-e364-4c2b-9814-96061ad47dd6", "tag": "volume-tag"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:18:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d6a8c013-14c2-49e1-8cc1-32a009845707 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "POST /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-volume_attachments" status: 200 len: 194 microversion: 2.49 time: 0.419461 Apr 14 04:19:00 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 66/188] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 04:18:59 2023] POST /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-volume_attachments => generated 194 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:19:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0ff43957-e670-46ca-88ec-0313ce5d9358 req-d01d3625-e551-4bef-acb2-e0b89b2240d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-plugged", "status": "completed", "tag": "25048f42-cfe5-48d1-8620-ac6ac6aa9b82"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ff43957-e670-46ca-88ec-0313ce5d9358 req-d01d3625-e551-4bef-acb2-e0b89b2240d1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ff43957-e670-46ca-88ec-0313ce5d9358 req-d01d3625-e551-4bef-acb2-e0b89b2240d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ff43957-e670-46ca-88ec-0313ce5d9358 req-d01d3625-e551-4bef-acb2-e0b89b2240d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0ff43957-e670-46ca-88ec-0313ce5d9358 req-d01d3625-e551-4bef-acb2-e0b89b2240d1 service nova] Creating event network-vif-plugged:25048f42-cfe5-48d1-8620-ac6ac6aa9b82 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:19:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0ff43957-e670-46ca-88ec-0313ce5d9358 req-d01d3625-e551-4bef-acb2-e0b89b2240d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039014 Apr 14 04:19:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 62/189] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2561790c-a2d5-4e77-abc3-fdbba85be5fd tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.090620 Apr 14 04:19:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 62/190] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:19:02 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-interface => generated 282 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 0ff97860-2441-437c-b118-6089c3cc4160] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] HTTP exception thrown: Instance 0ff97860-2441-437c-b118-6089c3cc4160 could not be found. Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Request method failure captured: Apr 14 04:19:03 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160 HTTP/1.1 Apr 14 04:19:03 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:19:03 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:19:03 user devstack@n-api.service[61596]: Connection: close Apr 14 04:19:03 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:19:03 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:19:03 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:19:03 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:19:03 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONORAYPuJkgqXTmM3qXuCWxDX_YO3IfDZ2aohNz60KBH9n2wih_4npphYtpn9Y9J8rcnig_Nv-d-cMu2E5hNo7xq9Bl_RZkRNGTuhPOfXoT9KjCLTAjUaj9HQIaXUvTGtIEJaqzpq4RdO1zyXz8fdDJxF9jKwyTK2Sbg63F-rZEIxm0 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Project-Id: 280aa55745a749b7baa134334d25c9c3 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesActionsTest-447148503 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280aa55745a749b7baa134334d25c9c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280aa55745a749b7baa134334d25c9c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280aa55745a749b7baa134334d25c9c3"}]}] Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesActionsTest-447148503 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Tenant-Id: 280aa55745a749b7baa134334d25c9c3 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesActionsTest-447148503 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-User: tempest-VolumesActionsTest-447148503-project-member Apr 14 04:19:03 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:19:03 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:19:03 user devstack@n-api.service[61596]: X-User-Id: 6e422970cd8340bf996a135088094f51 Apr 14 04:19:03 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesActionsTest-447148503-project-member Apr 14 04:19:03 user devstack@n-api.service[61596]: method: > Apr 14 04:19:03 user devstack@n-api.service[61596]: exception: Instance 0ff97860-2441-437c-b118-6089c3cc4160 could not be found. Apr 14 04:19:03 user devstack@n-api.service[61596]: action_args: {'id': '0ff97860-2441-437c-b118-6089c3cc4160'} Apr 14 04:19:03 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0ff97860-2441-437c-b118-6089c3cc4160 could not be found. Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0ff97860-2441-437c-b118-6089c3cc4160 could not be found. Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0ff97860-2441-437c-b118-6089c3cc4160 could not be found. Apr 14 04:19:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Returning 404 to user: Instance 0ff97860-2441-437c-b118-6089c3cc4160 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:19:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-55a9da8a-90e5-4eb9-9608-9ddf55b00a42 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160" status: 404 len: 111 microversion: 2.1 time: 0.072348 Apr 14 04:19:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 67/191] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:03 2023] GET /compute/v2.1/servers/0ff97860-2441-437c-b118-6089c3cc4160 => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f3255f25-0334-46dd-a514-12a56a1deffd"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-667634161", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "3019ebd6-056f-4b16-98f1-6aabc843f05d"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] validate_networks() for [('3019ebd6-056f-4b16-98f1-6aabc843f05d', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:19:03 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-9369e401-f616-43aa-82ff-882f10e94f56 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "POST /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.311153 Apr 14 04:19:03 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 63/192] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:19:03 2023] POST /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Getting quotas for project 280aa55745a749b7baa134334d25c9c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Getting quotas for user 6e422970cd8340bf996a135088094f51 and project 280aa55745a749b7baa134334d25c9c3. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:19:03 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 313835fa-6405-41ba-bc89-c4bfc119326a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:19:03 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-76b81920-c20f-4a9c-acba-50fdc8a92691 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.503520 Apr 14 04:19:03 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 63/193] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:19:03 2023] POST /compute/v2.1/servers => generated 378 bytes in 505 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-39e29c2d-bb2b-42e0-b16f-adb6cb2c6f86 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-39e29c2d-bb2b-42e0-b16f-adb6cb2c6f86 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 313835fa-6405-41ba-bc89-c4bfc119326a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-5c384eb1-00da-4da4-b8bb-2b0b67c68cf5 req-a023f1ff-4593-4ad2-b479-9412f1f66c63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7", "tag": "3f178241-75e2-4e0a-8d92-e647d05ed85e"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5c384eb1-00da-4da4-b8bb-2b0b67c68cf5 req-a023f1ff-4593-4ad2-b479-9412f1f66c63 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5c384eb1-00da-4da4-b8bb-2b0b67c68cf5 req-a023f1ff-4593-4ad2-b479-9412f1f66c63 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5c384eb1-00da-4da4-b8bb-2b0b67c68cf5 req-a023f1ff-4593-4ad2-b479-9412f1f66c63 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:03 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5c384eb1-00da-4da4-b8bb-2b0b67c68cf5 req-a023f1ff-4593-4ad2-b479-9412f1f66c63 service nova] Creating event network-changed:3f178241-75e2-4e0a-8d92-e647d05ed85e for instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 on user Apr 14 04:19:03 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-5c384eb1-00da-4da4-b8bb-2b0b67c68cf5 req-a023f1ff-4593-4ad2-b479-9412f1f66c63 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029084 Apr 14 04:19:03 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 64/194] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:03 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:03 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-39e29c2d-bb2b-42e0-b16f-adb6cb2c6f86 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e422970cd8340bf996a135088094f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280aa55745a749b7baa134334d25c9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-39e29c2d-bb2b-42e0-b16f-adb6cb2c6f86 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a" status: 200 len: 1207 microversion: 2.1 time: 0.076696 Apr 14 04:19:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 68/195] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:03 2023] GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a => generated 1207 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ec06d7ad-7a34-479b-94bd-4abb76a72299 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047486 Apr 14 04:19:04 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 64/196] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:04 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:04 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lazy-loading 'services' on Instance uuid e5344b0d-2d73-40c7-8ac3-535396e985a4 {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:19:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a576016a-f803-48c8-9e25-e783e410bdf5 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments/9c5e5b34-a82b-4011-88cb-968010ef59f9" status: 202 len: 0 microversion: 2.1 time: 0.281071 Apr 14 04:19:04 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 65/197] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:19:04 2023] DELETE /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments/9c5e5b34-a82b-4011-88cb-968010ef59f9 => generated 0 bytes in 283 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:06 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-8bda1527-2ee3-4e41-833a-e4e8ef26bc1a tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964" status: 200 len: 1493 microversion: 2.1 time: 0.210478 Apr 14 04:19:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 69/198] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:06 2023] GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 => generated 1493 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-42c0f7f2-143e-4596-b8f7-33d7d46c1d50 req-b2ea00c2-bf7b-495e-8bec-04e1eff57ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "313835fa-6405-41ba-bc89-c4bfc119326a", "tag": "243334e0-8471-4569-bb6a-38c530471bb4"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-42c0f7f2-143e-4596-b8f7-33d7d46c1d50 req-b2ea00c2-bf7b-495e-8bec-04e1eff57ffd service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-42c0f7f2-143e-4596-b8f7-33d7d46c1d50 req-b2ea00c2-bf7b-495e-8bec-04e1eff57ffd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-42c0f7f2-143e-4596-b8f7-33d7d46c1d50 req-b2ea00c2-bf7b-495e-8bec-04e1eff57ffd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-42c0f7f2-143e-4596-b8f7-33d7d46c1d50 req-b2ea00c2-bf7b-495e-8bec-04e1eff57ffd service nova] Creating event network-changed:243334e0-8471-4569-bb6a-38c530471bb4 for instance 313835fa-6405-41ba-bc89-c4bfc119326a on user Apr 14 04:19:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-42c0f7f2-143e-4596-b8f7-33d7d46c1d50 req-b2ea00c2-bf7b-495e-8bec-04e1eff57ffd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030487 Apr 14 04:19:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 65/199] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d8cf2c4e-2d1b-415c-bc79-3c4dcc462c76 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052071 Apr 14 04:19:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 66/200] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:07 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d6b0d46e-11c0-4db2-ab2c-ca37523b48a4 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058510 Apr 14 04:19:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 70/201] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:07 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:19:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-93f8b7e8-23e9-4da8-8ad3-0944afcee77e tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4" status: 204 len: 0 microversion: 2.1 time: 0.172008 Apr 14 04:19:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 66/202] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:19:08 2023] DELETE /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:08 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd1b09bc7a0344ae782d33d3222a8ea88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e0e636ba0ee9486f9f48905d886ab547', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-25be9414-175c-4629-b05b-10bdc750d049 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4" status: 200 len: 1675 microversion: 2.1 time: 0.207129 Apr 14 04:19:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 67/203] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:08 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 => generated 1675 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-668e773b-45b3-471a-9cc1-68bc391d5a8d req-88313ff8-ac5c-4da9-b6e0-1603ad4c4ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5344b0d-2d73-40c7-8ac3-535396e985a4", "name": "network-vif-unplugged", "status": "completed", "tag": "2d24208b-94ce-4364-86a4-1758c24e9047"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-668e773b-45b3-471a-9cc1-68bc391d5a8d req-88313ff8-ac5c-4da9-b6e0-1603ad4c4ba3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-668e773b-45b3-471a-9cc1-68bc391d5a8d req-88313ff8-ac5c-4da9-b6e0-1603ad4c4ba3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-668e773b-45b3-471a-9cc1-68bc391d5a8d req-88313ff8-ac5c-4da9-b6e0-1603ad4c4ba3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-668e773b-45b3-471a-9cc1-68bc391d5a8d req-88313ff8-ac5c-4da9-b6e0-1603ad4c4ba3 service nova] Creating event network-vif-unplugged:2d24208b-94ce-4364-86a4-1758c24e9047 for instance e5344b0d-2d73-40c7-8ac3-535396e985a4 on user Apr 14 04:19:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-668e773b-45b3-471a-9cc1-68bc391d5a8d req-88313ff8-ac5c-4da9-b6e0-1603ad4c4ba3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083228 Apr 14 04:19:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 67/204] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:08 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lazy-loading 'services' on Instance uuid 8ed1dea8-e48a-49f7-924e-82cf639a1677 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:19:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-0ff8fb13-c821-49ed-bb1a-b21e6652ab26 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-volume_attachments/80a9f7e6-e364-4c2b-9814-96061ad47dd6" status: 202 len: 0 microversion: 2.49 time: 0.332523 Apr 14 04:19:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 71/205] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 04:19:08 2023] DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-volume_attachments/80a9f7e6-e364-4c2b-9814-96061ad47dd6 => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:19:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-31225ef8-5c3f-49f1-bd52-d39bcbea3f1e req-f7f6f835-b2cb-41e7-be12-0ffdc7287557 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5344b0d-2d73-40c7-8ac3-535396e985a4", "name": "network-vif-deleted", "tag": "2d24208b-94ce-4364-86a4-1758c24e9047"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-31225ef8-5c3f-49f1-bd52-d39bcbea3f1e req-f7f6f835-b2cb-41e7-be12-0ffdc7287557 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-31225ef8-5c3f-49f1-bd52-d39bcbea3f1e req-f7f6f835-b2cb-41e7-be12-0ffdc7287557 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-31225ef8-5c3f-49f1-bd52-d39bcbea3f1e req-f7f6f835-b2cb-41e7-be12-0ffdc7287557 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-31225ef8-5c3f-49f1-bd52-d39bcbea3f1e req-f7f6f835-b2cb-41e7-be12-0ffdc7287557 service nova] Creating event network-vif-deleted:2d24208b-94ce-4364-86a4-1758c24e9047 for instance e5344b0d-2d73-40c7-8ac3-535396e985a4 on user Apr 14 04:19:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-31225ef8-5c3f-49f1-bd52-d39bcbea3f1e req-f7f6f835-b2cb-41e7-be12-0ffdc7287557 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031019 Apr 14 04:19:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 68/206] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5344b0d-2d73-40c7-8ac3-535396e985a4", "name": "network-vif-plugged", "status": "completed", "tag": "2d24208b-94ce-4364-86a4-1758c24e9047"}, {"server_uuid": "313835fa-6405-41ba-bc89-c4bfc119326a", "name": "network-vif-plugged", "status": "completed", "tag": "243334e0-8471-4569-bb6a-38c530471bb4"}, {"server_uuid": "313835fa-6405-41ba-bc89-c4bfc119326a", "name": "network-vif-plugged", "status": "completed", "tag": "243334e0-8471-4569-bb6a-38c530471bb4"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] Creating event network-vif-plugged:2d24208b-94ce-4364-86a4-1758c24e9047 for instance e5344b0d-2d73-40c7-8ac3-535396e985a4 on user Apr 14 04:19:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] Creating event network-vif-plugged:243334e0-8471-4569-bb6a-38c530471bb4 for instance 313835fa-6405-41ba-bc89-c4bfc119326a on user Apr 14 04:19:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] Creating event network-vif-plugged:243334e0-8471-4569-bb6a-38c530471bb4 for instance 313835fa-6405-41ba-bc89-c4bfc119326a on user Apr 14 04:19:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-36c387b3-a42a-419d-944c-422baa575151 req-6195e96b-cfe3-4927-851a-c00ad9c17a99 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.037093 Apr 14 04:19:10 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 68/207] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:10 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-12f5a389-dccc-48e0-866c-b307238d063a tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-interface/25048f42-cfe5-48d1-8620-ac6ac6aa9b82" status: 202 len: 0 microversion: 2.49 time: 0.058363 Apr 14 04:19:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 69/208] 10.0.0.210 () {64 vars in 1507 bytes} [Fri Apr 14 04:19:11 2023] DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-interface/25048f42-cfe5-48d1-8620-ac6ac6aa9b82 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fdd84338-e2e6-4140-bf27-b20fbbb803b3 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-instance-actions/req-12f5a389-dccc-48e0-866c-b307238d063a" status: 200 len: 474 microversion: 2.49 time: 0.208338 Apr 14 04:19:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 69/209] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 04:19:11 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-instance-actions/req-12f5a389-dccc-48e0-866c-b307238d063a => generated 474 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:19:11 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-18d7ebe5-0721-40e7-b84a-27f3b8debe41 tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments/f3255f25-0334-46dd-a514-12a56a1deffd" status: 202 len: 0 microversion: 2.1 time: 0.577410 Apr 14 04:19:11 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 72/210] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 04:19:11 2023] PUT /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments/f3255f25-0334-46dd-a514-12a56a1deffd => generated 0 bytes in 579 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:19:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-963b6ed9-00e8-44b0-986c-fe4ad49ea734 req-29d26773-fa7e-4f5a-98be-beb58f6bff30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-deleted", "tag": "25048f42-cfe5-48d1-8620-ac6ac6aa9b82"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-963b6ed9-00e8-44b0-986c-fe4ad49ea734 req-29d26773-fa7e-4f5a-98be-beb58f6bff30 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-963b6ed9-00e8-44b0-986c-fe4ad49ea734 req-29d26773-fa7e-4f5a-98be-beb58f6bff30 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-963b6ed9-00e8-44b0-986c-fe4ad49ea734 req-29d26773-fa7e-4f5a-98be-beb58f6bff30 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-963b6ed9-00e8-44b0-986c-fe4ad49ea734 req-29d26773-fa7e-4f5a-98be-beb58f6bff30 service nova] Creating event network-vif-deleted:25048f42-cfe5-48d1-8620-ac6ac6aa9b82 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:19:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-963b6ed9-00e8-44b0-986c-fe4ad49ea734 req-29d26773-fa7e-4f5a-98be-beb58f6bff30 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029596 Apr 14 04:19:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 70/211] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-869462ad-2663-4fde-bf96-da92f31a7e64 req-dfe20067-414f-41e0-93c6-561aaaedd54b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-unplugged", "status": "completed", "tag": "25048f42-cfe5-48d1-8620-ac6ac6aa9b82"}, {"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-plugged", "status": "completed", "tag": "25048f42-cfe5-48d1-8620-ac6ac6aa9b82"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-869462ad-2663-4fde-bf96-da92f31a7e64 req-dfe20067-414f-41e0-93c6-561aaaedd54b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-869462ad-2663-4fde-bf96-da92f31a7e64 req-dfe20067-414f-41e0-93c6-561aaaedd54b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-869462ad-2663-4fde-bf96-da92f31a7e64 req-dfe20067-414f-41e0-93c6-561aaaedd54b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-869462ad-2663-4fde-bf96-da92f31a7e64 req-dfe20067-414f-41e0-93c6-561aaaedd54b service nova] Creating event network-vif-unplugged:25048f42-cfe5-48d1-8620-ac6ac6aa9b82 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:19:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-869462ad-2663-4fde-bf96-da92f31a7e64 req-dfe20067-414f-41e0-93c6-561aaaedd54b service nova] Creating event network-vif-plugged:25048f42-cfe5-48d1-8620-ac6ac6aa9b82 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:19:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-869462ad-2663-4fde-bf96-da92f31a7e64 req-dfe20067-414f-41e0-93c6-561aaaedd54b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033381 Apr 14 04:19:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 70/212] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=22 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=55,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:23 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f1769fed-037b-481b-8d0b-6b2254cf5cc3 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.061906 Apr 14 04:19:23 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 73/213] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:23 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=24 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-e0aa3647-9030-4533-8df3-6ddc007d920c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049384 Apr 14 04:19:23 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 71/214] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:23 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "f3255f25-0334-46dd-a514-12a56a1deffd"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=56,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-b832fbb5-91ab-4a5e-a1b5-b07052007feb tempest-TestVolumeSwap-117798025 tempest-TestVolumeSwap-117798025-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments/eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370" status: 202 len: 0 microversion: 2.1 time: 0.319447 Apr 14 04:19:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 71/215] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 04:19:23 2023] PUT /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments/eb2fcdfc-806a-4eb7-8ed3-bb78c58cc370 => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:25 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-6ecc2a3d-0b98-4110-a743-817f5ee53407 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a" status: 200 len: 1490 microversion: 2.1 time: 0.202088 Apr 14 04:19:25 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 74/216] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:25 2023] GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a => generated 1490 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:25 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-aea98020-6b59-4c9c-bb8a-f7071f87e9f0 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1656 microversion: 2.1 time: 0.155229 Apr 14 04:19:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 72/217] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:25 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:25 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:26 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:26 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-73cb1a00-f0c6-4eb8-af8e-d8229870aa4a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1656 microversion: 2.1 time: 0.164435 Apr 14 04:19:26 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 72/218] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:25 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1656 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:27 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:27 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-fef497a1-f1cc-48e7-aa41-13ba0623e1f8 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1690 microversion: 2.1 time: 0.150525 Apr 14 04:19:27 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 75/219] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:27 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1690 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] HTTP exception thrown: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Request method failure captured: Apr 14 04:19:29 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb HTTP/1.1 Apr 14 04:19:29 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:19:29 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:19:29 user devstack@n-api.service[61595]: Connection: close Apr 14 04:19:29 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:19:29 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:19:29 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:19:29 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:19:29 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOjrUl5SbwvnZDT5wwelogfLFzkX5lCO_xBeuYaUPeaSqxLsMJqQXZL1UuDqh8LdXdJrpFXCTnIm7fhkTGYgOZ7kFEE3eKo5CGsiAoRWeilycPCm-GoWirp5yTJ1tTwqdFZilS2s5U5FLIxg9eju_8xtkRDPixm35tX7ZpAQ0fpPtg Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Project-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Project-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}] Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Tenant: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Tenant-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:29 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:29 user devstack@n-api.service[61595]: X-User: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:29 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:19:29 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:19:29 user devstack@n-api.service[61595]: X-User-Id: fab852bb302f44b1af63083c99ea244c Apr 14 04:19:29 user devstack@n-api.service[61595]: X-User-Name: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:29 user devstack@n-api.service[61595]: method: > Apr 14 04:19:29 user devstack@n-api.service[61595]: exception: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61595]: action_args: {'id': 'e37e27b4-0813-4df9-ac66-1516334c12cb'} Apr 14 04:19:29 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Returning 404 to user: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:19:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-66c8b31c-1736-47f7-9b47-10ae89893ec9 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb" status: 404 len: 111 microversion: 2.1 time: 0.040434 Apr 14 04:19:29 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 73/220] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:29 2023] GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] HTTP exception thrown: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Request method failure captured: Apr 14 04:19:29 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb/os-volume_attachments HTTP/1.1 Apr 14 04:19:29 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:19:29 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:19:29 user devstack@n-api.service[61597]: Connection: close Apr 14 04:19:29 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:19:29 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:19:29 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:19:29 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:19:29 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOjrUl5SbwvnZDT5wwelogfLFzkX5lCO_xBeuYaUPeaSqxLsMJqQXZL1UuDqh8LdXdJrpFXCTnIm7fhkTGYgOZ7kFEE3eKo5CGsiAoRWeilycPCm-GoWirp5yTJ1tTwqdFZilS2s5U5FLIxg9eju_8xtkRDPixm35tX7ZpAQ0fpPtg Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Project-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Project-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}] Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Tenant: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Tenant-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:29 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:29 user devstack@n-api.service[61597]: X-User: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:29 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:19:29 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:19:29 user devstack@n-api.service[61597]: X-User-Id: fab852bb302f44b1af63083c99ea244c Apr 14 04:19:29 user devstack@n-api.service[61597]: X-User-Name: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:29 user devstack@n-api.service[61597]: method: > Apr 14 04:19:29 user devstack@n-api.service[61597]: exception: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61597]: action_args: {'server_id': 'e37e27b4-0813-4df9-ac66-1516334c12cb'} Apr 14 04:19:29 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:29 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:29 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Returning 404 to user: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:19:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-09b8383c-455d-4f7d-8b39-8824bb70176b tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039057 Apr 14 04:19:29 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 73/221] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:29 2023] GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb/os-volume_attachments => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:19:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-91dc4812-9d1e-4988-ae5a-75554cf057ae tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '.version_select at 0x7f538b2413f0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-91dc4812-9d1e-4988-ae5a-75554cf057ae tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8" status: 200 len: 1725 microversion: 2.1 time: 0.132411 Apr 14 04:19:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 76/222] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 04:19:31 2023] GET /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8 => generated 1725 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-bf2a52a0-39a8-4294-abcf-bea19dd3f5ff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '.version_select at 0x7f538afa97e0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-bf2a52a0-39a8-4294-abcf-bea19dd3f5ff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8" status: 200 len: 1725 microversion: 2.1 time: 0.088425 Apr 14 04:19:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 74/223] 10.0.0.210 () {62 vars in 1310 bytes} [Fri Apr 14 04:19:31 2023] GET /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8 => generated 1725 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:31 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d80d3684045298d895555247174af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bb9ddec81e4f6cbceb6ce7dee9c3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-07be378e-767e-4592-bba3-94b7095ebbd1 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 200 len: 1672 microversion: 2.1 time: 0.202476 Apr 14 04:19:31 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 74/224] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:31 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 1672 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:32 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-6c017fa7-dd6f-47e5-a008-82e6f90a5c84 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.177072 Apr 14 04:19:32 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 77/225] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 04:19:32 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02/os-interface => generated 1830 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] HTTP exception thrown: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Request method failure captured: Apr 14 04:19:32 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb HTTP/1.1 Apr 14 04:19:32 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:19:32 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:19:32 user devstack@n-api.service[61595]: Connection: close Apr 14 04:19:32 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:19:32 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:19:32 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:19:32 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:19:32 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOjrUl5SbwvnZDT5wwelogfLFzkX5lCO_xBeuYaUPeaSqxLsMJqQXZL1UuDqh8LdXdJrpFXCTnIm7fhkTGYgOZ7kFEE3eKo5CGsiAoRWeilycPCm-GoWirp5yTJ1tTwqdFZilS2s5U5FLIxg9eju_8xtkRDPixm35tX7ZpAQ0fpPtg Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Project-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Project-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}] Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Tenant: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Tenant-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:32 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:32 user devstack@n-api.service[61595]: X-User: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:32 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:19:32 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:19:32 user devstack@n-api.service[61595]: X-User-Id: fab852bb302f44b1af63083c99ea244c Apr 14 04:19:32 user devstack@n-api.service[61595]: X-User-Name: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:32 user devstack@n-api.service[61595]: method: > Apr 14 04:19:32 user devstack@n-api.service[61595]: exception: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:32 user devstack@n-api.service[61595]: action_args: {'id': 'e37e27b4-0813-4df9-ac66-1516334c12cb'} Apr 14 04:19:32 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Returning 404 to user: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:19:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6cbde73a-d18e-4fc6-a545-18324ef8e404 tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb" status: 404 len: 111 microversion: 2.1 time: 0.056837 Apr 14 04:19:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 75/226] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:19:32 2023] DELETE /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] [instance: e37e27b4-0813-4df9-ac66-1516334c12cb] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:33 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] HTTP exception thrown: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Request method failure captured: Apr 14 04:19:33 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb HTTP/1.1 Apr 14 04:19:33 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:19:33 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:19:33 user devstack@n-api.service[61597]: Connection: close Apr 14 04:19:33 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:19:33 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:19:33 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:19:33 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:19:33 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOjrUl5SbwvnZDT5wwelogfLFzkX5lCO_xBeuYaUPeaSqxLsMJqQXZL1UuDqh8LdXdJrpFXCTnIm7fhkTGYgOZ7kFEE3eKo5CGsiAoRWeilycPCm-GoWirp5yTJ1tTwqdFZilS2s5U5FLIxg9eju_8xtkRDPixm35tX7ZpAQ0fpPtg Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Project-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Project-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ce5e634f187b470085e7bfb3c1cfcbe7"}]}] Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Tenant: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Tenant-Id: ce5e634f187b470085e7bfb3c1cfcbe7 Apr 14 04:19:33 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-DeleteServersTestJSON-2046031715 Apr 14 04:19:33 user devstack@n-api.service[61597]: X-User: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:33 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:19:33 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:19:33 user devstack@n-api.service[61597]: X-User-Id: fab852bb302f44b1af63083c99ea244c Apr 14 04:19:33 user devstack@n-api.service[61597]: X-User-Name: tempest-DeleteServersTestJSON-2046031715-project-member Apr 14 04:19:33 user devstack@n-api.service[61597]: method: > Apr 14 04:19:33 user devstack@n-api.service[61597]: exception: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:33 user devstack@n-api.service[61597]: action_args: {'id': 'e37e27b4-0813-4df9-ac66-1516334c12cb'} Apr 14 04:19:33 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. Apr 14 04:19:33 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:19:33 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] Returning 404 to user: Instance e37e27b4-0813-4df9-ac66-1516334c12cb could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:19:33 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3fe64933-6ece-4010-8f38-e2bf652a39ad tempest-DeleteServersTestJSON-2046031715 tempest-DeleteServersTestJSON-2046031715-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb" status: 404 len: 111 microversion: 2.1 time: 0.062406 Apr 14 04:19:33 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 75/227] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:32 2023] GET /compute/v2.1/servers/e37e27b4-0813-4df9-ac66-1516334c12cb => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:19:34 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-b5ecd7cb-ee77-4e58-9f98-3ead13b7939c req-71bd4c72-1553-4e76-9325-130b542d06c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "tag": "eea29fce-f6e3-4715-9a46-2a638462c6f8"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b5ecd7cb-ee77-4e58-9f98-3ead13b7939c req-71bd4c72-1553-4e76-9325-130b542d06c0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b5ecd7cb-ee77-4e58-9f98-3ead13b7939c req-71bd4c72-1553-4e76-9325-130b542d06c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b5ecd7cb-ee77-4e58-9f98-3ead13b7939c req-71bd4c72-1553-4e76-9325-130b542d06c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:34 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-b5ecd7cb-ee77-4e58-9f98-3ead13b7939c req-71bd4c72-1553-4e76-9325-130b542d06c0 service nova] Creating event network-changed:eea29fce-f6e3-4715-9a46-2a638462c6f8 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:34 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-b5ecd7cb-ee77-4e58-9f98-3ead13b7939c req-71bd4c72-1553-4e76-9325-130b542d06c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065148 Apr 14 04:19:34 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 78/228] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:34 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:34 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-054578ef-c880-4452-8aaf-38ec77ba79f7 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 200 len: 2827 microversion: 2.42 time: 0.631846 Apr 14 04:19:34 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 76/229] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:19:34 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 2827 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:19:34 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:34 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a3d2d9b6-5f13-4d69-abea-2bbb1c466fc5 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02/os-interface" status: 200 len: 1830 microversion: 2.42 time: 0.197440 Apr 14 04:19:35 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 76/230] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 04:19:34 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02/os-interface => generated 1830 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:19:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-dc9f897b-1670-4413-81a6-b50aae1af03b tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 204 len: 0 microversion: 2.42 time: 0.148641 Apr 14 04:19:36 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 79/231] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:19:36 2023] DELETE /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:36 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a73bf814-3a92-4ff2-9007-37bee9b7a6bf req-a28698ae-9bf6-433f-97f1-676fc07517aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "eea29fce-f6e3-4715-9a46-2a638462c6f8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a73bf814-3a92-4ff2-9007-37bee9b7a6bf req-a28698ae-9bf6-433f-97f1-676fc07517aa service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a73bf814-3a92-4ff2-9007-37bee9b7a6bf req-a28698ae-9bf6-433f-97f1-676fc07517aa service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a73bf814-3a92-4ff2-9007-37bee9b7a6bf req-a28698ae-9bf6-433f-97f1-676fc07517aa service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:36 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a73bf814-3a92-4ff2-9007-37bee9b7a6bf req-a28698ae-9bf6-433f-97f1-676fc07517aa service nova] Creating event network-vif-unplugged:eea29fce-f6e3-4715-9a46-2a638462c6f8 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:36 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a73bf814-3a92-4ff2-9007-37bee9b7a6bf req-a28698ae-9bf6-433f-97f1-676fc07517aa service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048619 Apr 14 04:19:36 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 77/232] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-d8a933fd-578b-4393-b4cb-1a7343b4c27e req-84482fc8-025b-4676-8102-3388278d4d9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "8c995dcb-b43b-4bdd-b631-e3b6104d49d0"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:36 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b848680106b74275a947f316ce6311fd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '225e61ca983d4f27adc61ad33c81fce4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:36 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-158c4db9-8cd0-438a-b705-a2690623b433 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 200 len: 2952 microversion: 2.42 time: 0.487873 Apr 14 04:19:36 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 77/233] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:19:36 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 2952 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-d8a933fd-578b-4393-b4cb-1a7343b4c27e req-84482fc8-025b-4676-8102-3388278d4d9d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-d8a933fd-578b-4393-b4cb-1a7343b4c27e req-84482fc8-025b-4676-8102-3388278d4d9d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-d8a933fd-578b-4393-b4cb-1a7343b4c27e req-84482fc8-025b-4676-8102-3388278d4d9d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-d8a933fd-578b-4393-b4cb-1a7343b4c27e req-84482fc8-025b-4676-8102-3388278d4d9d service nova] Creating event network-vif-unplugged:8c995dcb-b43b-4bdd-b631-e3b6104d49d0 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-d8a933fd-578b-4393-b4cb-1a7343b4c27e req-84482fc8-025b-4676-8102-3388278d4d9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.089460 Apr 14 04:19:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 80/234] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:36 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-415fd552-3301-48c4-9e60-343c29e9b499 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.074010 Apr 14 04:19:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 78/235] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:37 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments => generated 197 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-e193585d-320c-4868-be42-2822d199cd8a tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066642 Apr 14 04:19:37 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 78/236] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:37 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lazy-loading 'services' on Instance uuid b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:19:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b3742b90-6cb5-448d-a7b9-50727360ccc6 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments/f3255f25-0334-46dd-a514-12a56a1deffd" status: 202 len: 0 microversion: 2.1 time: 0.342652 Apr 14 04:19:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 81/237] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:19:37 2023] DELETE /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments/f3255f25-0334-46dd-a514-12a56a1deffd => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f9862d53-6859-469d-bfe4-1acdcfa39f4c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052824 Apr 14 04:19:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 79/238] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:19:37 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "eea29fce-f6e3-4715-9a46-2a638462c6f8"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "8257c16c-6115-4b67-a739-91cb1d5e8bc6"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "8257c16c-6115-4b67-a739-91cb1d5e8bc6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Creating event network-vif-plugged:eea29fce-f6e3-4715-9a46-2a638462c6f8 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Creating event network-vif-unplugged:11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Creating event network-vif-plugged:11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Creating event network-vif-unplugged:8257c16c-6115-4b67-a739-91cb1d5e8bc6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] Creating event network-vif-plugged:8257c16c-6115-4b67-a739-91cb1d5e8bc6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-e5f02f87-45e2-49ee-9c34-a85886a450bf req-ce94e23a-7559-44c3-b62c-7032a8b9c804 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 871 microversion: 2.1 time: 0.043661 Apr 14 04:19:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 79/239] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:38 2023] POST /compute/v2.1/os-server-external-events => generated 871 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "8c995dcb-b43b-4bdd-b631-e3b6104d49d0"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "c9994009-b14a-4ff4-ac36-f02b0feccfb6"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "c9994009-b14a-4ff4-ac36-f02b0feccfb6"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-unplugged", "status": "completed", "tag": "512baf47-b5bf-4cf0-8300-f0e0167fc70e"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-plugged", "status": "completed", "tag": "512baf47-b5bf-4cf0-8300-f0e0167fc70e"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Creating event network-vif-plugged:8c995dcb-b43b-4bdd-b631-e3b6104d49d0 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Creating event network-vif-unplugged:c9994009-b14a-4ff4-ac36-f02b0feccfb6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Creating event network-vif-plugged:c9994009-b14a-4ff4-ac36-f02b0feccfb6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Creating event network-vif-unplugged:07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Creating event network-vif-plugged:07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Creating event network-vif-unplugged:512baf47-b5bf-4cf0-8300-f0e0167fc70e for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] Creating event network-vif-plugged:512baf47-b5bf-4cf0-8300-f0e0167fc70e for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-2e51c944-ba82-4528-90e1-94b23c58a4fb req-be5a2f41-fe07-4462-9e56-2caad3b93add service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 1215 microversion: 2.1 time: 0.043414 Apr 14 04:19:39 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 82/240] 10.0.0.210 () {68 vars in 1395 bytes} [Fri Apr 14 04:19:39 2023] POST /compute/v2.1/os-server-external-events => generated 1215 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-410ee83a-1aaa-4a13-8cac-4a563317a793 req-4e73289a-bc89-4d56-b754-801eab0e7a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-deleted", "tag": "eea29fce-f6e3-4715-9a46-2a638462c6f8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-410ee83a-1aaa-4a13-8cac-4a563317a793 req-4e73289a-bc89-4d56-b754-801eab0e7a77 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-410ee83a-1aaa-4a13-8cac-4a563317a793 req-4e73289a-bc89-4d56-b754-801eab0e7a77 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-410ee83a-1aaa-4a13-8cac-4a563317a793 req-4e73289a-bc89-4d56-b754-801eab0e7a77 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-410ee83a-1aaa-4a13-8cac-4a563317a793 req-4e73289a-bc89-4d56-b754-801eab0e7a77 service nova] Creating event network-vif-deleted:eea29fce-f6e3-4715-9a46-2a638462c6f8 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-410ee83a-1aaa-4a13-8cac-4a563317a793 req-4e73289a-bc89-4d56-b754-801eab0e7a77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031884 Apr 14 04:19:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 80/241] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:44 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-deleted", "tag": "11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-deleted", "tag": "07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-deleted", "tag": "8257c16c-6115-4b67-a739-91cb1d5e8bc6"}, {"server_uuid": "55ba1cae-2b2f-43de-86db-996a8791fb02", "name": "network-vif-deleted", "tag": "512baf47-b5bf-4cf0-8300-f0e0167fc70e"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Creating event network-vif-deleted:11fd6438-8a9b-4c97-8a6f-da3ddfc36ebe for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Creating event network-vif-deleted:07a4c8ef-59a4-4112-8dd7-0e5ffd9021a5 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Creating event network-vif-deleted:8257c16c-6115-4b67-a739-91cb1d5e8bc6 for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] Creating event network-vif-deleted:512baf47-b5bf-4cf0-8300-f0e0167fc70e for instance 55ba1cae-2b2f-43de-86db-996a8791fb02 on user Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-03198ff2-c560-479b-a571-93b2aba8a6bc req-8dde7324-f62f-4e08-ad58-c8081f171895 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.038635 Apr 14 04:19:44 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 80/242] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:19:44 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:45 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:45 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-0687bc73-7adb-4d2a-bb91-bfcf9250c286 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1533 microversion: 2.1 time: 0.913265 Apr 14 04:19:45 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 83/243] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:44 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1533 bytes in 915 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Searching by: {'deleted': False, 'project_id': '0a60f60717b44f4ba904a949eabfe608'} {{(pid=61597) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:45 user devstack@n-api.service[61597]: DEBUG nova.compute.multi_cell_list [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61597) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 04:19:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ce7bae38-151e-4575-b1bf-e99a071cf1f0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 339 microversion: 2.1 time: 0.315002 Apr 14 04:19:45 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 81/244] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 04:19:45 2023] GET /compute/v2.1/servers => generated 339 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:45 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:45 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-fc49141b-d0d1-4d19-ad7f-59764079e041 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1533 microversion: 2.1 time: 0.210111 Apr 14 04:19:45 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 81/245] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:45 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1533 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70317b0d-2515-45ac-825b-207626822497"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ebc290f9-6648-4d11-bda1-1a8ae965d20c tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282798 Apr 14 04:19:48 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 84/246] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:19:48 2023] POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 313835fa-6405-41ba-bc89-c4bfc119326a] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=23 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:53 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:54 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e422970cd8340bf996a135088094f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280aa55745a749b7baa134334d25c9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:19:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-466f6d26-b3a7-4ad6-82d1-1bb07a05f5e4 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a" status: 200 len: 1484 microversion: 2.1 time: 0.170083 Apr 14 04:19:54 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 82/247] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:53 2023] GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a => generated 1484 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=20 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=44 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] HTTP exception thrown: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Request method failure captured: Apr 14 04:19:58 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 HTTP/1.1 Apr 14 04:19:58 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:19:58 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:19:58 user devstack@n-api.service[61595]: Connection: close Apr 14 04:19:58 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:19:58 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:19:58 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:19:58 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:19:58 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOZC_zW7MfICDnY3Lx6cbTw7wyIhSemoHIflS_GMIjBTaTMn1UmO9W7VT6ngdSgzAK_6ZSGtSujaGW6MbhPYeUGCfKb30RXyVatT3dvSiKoAa7kBg8LV5nuj2kFJGPzQZM2Djp7Jd_97bGMuFwjVtJPcltPOR6Ff0Jk3kzktTijtCY Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Project-Id: e0e636ba0ee9486f9f48905d886ab547 Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e0e636ba0ee9486f9f48905d886ab547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0e636ba0ee9486f9f48905d886ab547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0e636ba0ee9486f9f48905d886ab547"}]}] Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Tenant-Id: e0e636ba0ee9486f9f48905d886ab547 Apr 14 04:19:58 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:19:58 user devstack@n-api.service[61595]: X-User: tempest-AttachSCSIVolumeTestJSON-1503158328-project-member Apr 14 04:19:58 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:19:58 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:19:58 user devstack@n-api.service[61595]: X-User-Id: d1b09bc7a0344ae782d33d3222a8ea88 Apr 14 04:19:58 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1503158328-project-member Apr 14 04:19:58 user devstack@n-api.service[61595]: method: > Apr 14 04:19:58 user devstack@n-api.service[61595]: exception: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:19:58 user devstack@n-api.service[61595]: action_args: {'id': 'e5344b0d-2d73-40c7-8ac3-535396e985a4'} Apr 14 04:19:58 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:19:58 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:19:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Returning 404 to user: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:19:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-640ec66f-7407-45fd-8e00-4774ea2449c0 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4" status: 404 len: 111 microversion: 2.1 time: 0.047970 Apr 14 04:19:58 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 82/248] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:58 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:19:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-08d46b8a-29dc-4864-89f0-f090b00e2669 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '.version_select at 0x7f538b0f5bd0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:58 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-08d46b8a-29dc-4864-89f0-f090b00e2669 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075478387" status: 202 len: 0 microversion: 2.1 time: 0.036004 Apr 14 04:19:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 85/249] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:19:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2075478387 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:19:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:00 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:00 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9264506d-44bf-4247-9b9c-3160b6212f28 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1579 microversion: 2.1 time: 0.169717 Apr 14 04:20:00 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 83/250] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:19:59 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1579 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-864d8ce8-189e-48d0-93a5-018c9c7fea1b tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-instance-actions/req-12f5a389-dccc-48e0-866c-b307238d063a" status: 200 len: 503 microversion: 2.49 time: 0.092254 Apr 14 04:20:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 83/251] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 04:20:01 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-instance-actions/req-12f5a389-dccc-48e0-866c-b307238d063a => generated 503 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7f543228-fd05-4521-bad8-e3623b796b12 tempest-TaggedAttachmentsTest-828791774 tempest-TaggedAttachmentsTest-828791774-project-admin] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-instance-actions/req-12f5a389-dccc-48e0-866c-b307238d063a" status: 200 len: 503 microversion: 2.49 time: 0.085379 Apr 14 04:20:01 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 86/252] 10.0.0.210 () {64 vars in 1537 bytes} [Fri Apr 14 04:20:01 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-instance-actions/req-12f5a389-dccc-48e0-866c-b307238d063a => generated 503 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4731ce28-01b2-4c4f-96d0-bb958a778d33 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-volume_attachments" status: 200 len: 25 microversion: 2.49 time: 0.050245 Apr 14 04:20:01 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 84/253] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 04:20:01 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-51daa497-ae8f-43ab-8a4f-2ab88c08900f req-7993aecd-3f3f-467f-aa13-b97e9f34b606 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-51daa497-ae8f-43ab-8a4f-2ab88c08900f req-7993aecd-3f3f-467f-aa13-b97e9f34b606 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-51daa497-ae8f-43ab-8a4f-2ab88c08900f req-7993aecd-3f3f-467f-aa13-b97e9f34b606 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-51daa497-ae8f-43ab-8a4f-2ab88c08900f req-7993aecd-3f3f-467f-aa13-b97e9f34b606 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-51daa497-ae8f-43ab-8a4f-2ab88c08900f req-7993aecd-3f3f-467f-aa13-b97e9f34b606 service nova] Creating event network-changed:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:20:01 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-51daa497-ae8f-43ab-8a4f-2ab88c08900f req-7993aecd-3f3f-467f-aa13-b97e9f34b606 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035537 Apr 14 04:20:01 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 87/254] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:01 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d37981da-5589-4cb9-82b6-7d96d273bda4 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 204 len: 0 microversion: 2.49 time: 0.114593 Apr 14 04:20:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 84/255] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:20:01 2023] DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:02 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:02 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:02 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '0aeeeae7cbc340daa8cd81c1418794e0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '01cefa66350a4432ad71204b39e953be', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-606a7b73-5fb2-49f9-b12d-ab68d2153bea tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 200 len: 1750 microversion: 2.49 time: 0.286161 Apr 14 04:20:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 85/256] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:20:01 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 1750 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] HTTP exception thrown: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Request method failure captured: Apr 14 04:20:02 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 HTTP/1.1 Apr 14 04:20:02 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:20:02 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:20:02 user devstack@n-api.service[61596]: Connection: close Apr 14 04:20:02 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:20:02 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:20:02 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:20:02 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:20:02 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOZC_zW7MfICDnY3Lx6cbTw7wyIhSemoHIflS_GMIjBTaTMn1UmO9W7VT6ngdSgzAK_6ZSGtSujaGW6MbhPYeUGCfKb30RXyVatT3dvSiKoAa7kBg8LV5nuj2kFJGPzQZM2Djp7Jd_97bGMuFwjVtJPcltPOR6Ff0Jk3kzktTijtCY Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Project-Id: e0e636ba0ee9486f9f48905d886ab547 Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e0e636ba0ee9486f9f48905d886ab547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0e636ba0ee9486f9f48905d886ab547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0e636ba0ee9486f9f48905d886ab547"}]}] Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Tenant-Id: e0e636ba0ee9486f9f48905d886ab547 Apr 14 04:20:02 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:20:02 user devstack@n-api.service[61596]: X-User: tempest-AttachSCSIVolumeTestJSON-1503158328-project-member Apr 14 04:20:02 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:20:02 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:20:02 user devstack@n-api.service[61596]: X-User-Id: d1b09bc7a0344ae782d33d3222a8ea88 Apr 14 04:20:02 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1503158328-project-member Apr 14 04:20:02 user devstack@n-api.service[61596]: method: > Apr 14 04:20:02 user devstack@n-api.service[61596]: exception: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:02 user devstack@n-api.service[61596]: action_args: {'id': 'e5344b0d-2d73-40c7-8ac3-535396e985a4'} Apr 14 04:20:02 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Returning 404 to user: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-eb2e1e55-8d51-456e-968e-0a5d6b95f8b8 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4" status: 404 len: 111 microversion: 2.1 time: 0.054056 Apr 14 04:20:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 88/257] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:20:02 2023] DELETE /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] [instance: e5344b0d-2d73-40c7-8ac3-535396e985a4] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:03 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] HTTP exception thrown: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:03 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Request method failure captured: Apr 14 04:20:03 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 HTTP/1.1 Apr 14 04:20:03 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:20:03 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:20:03 user devstack@n-api.service[61595]: Connection: close Apr 14 04:20:03 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:20:03 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:20:03 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:20:03 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:20:03 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOZC_zW7MfICDnY3Lx6cbTw7wyIhSemoHIflS_GMIjBTaTMn1UmO9W7VT6ngdSgzAK_6ZSGtSujaGW6MbhPYeUGCfKb30RXyVatT3dvSiKoAa7kBg8LV5nuj2kFJGPzQZM2Djp7Jd_97bGMuFwjVtJPcltPOR6Ff0Jk3kzktTijtCY Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Project-Id: e0e636ba0ee9486f9f48905d886ab547 Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/e0e636ba0ee9486f9f48905d886ab547"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0e636ba0ee9486f9f48905d886ab547"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/e0e636ba0ee9486f9f48905d886ab547"}]}] Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Tenant-Id: e0e636ba0ee9486f9f48905d886ab547 Apr 14 04:20:03 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachSCSIVolumeTestJSON-1503158328 Apr 14 04:20:03 user devstack@n-api.service[61595]: X-User: tempest-AttachSCSIVolumeTestJSON-1503158328-project-member Apr 14 04:20:03 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:20:03 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:20:03 user devstack@n-api.service[61595]: X-User-Id: d1b09bc7a0344ae782d33d3222a8ea88 Apr 14 04:20:03 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachSCSIVolumeTestJSON-1503158328-project-member Apr 14 04:20:03 user devstack@n-api.service[61595]: method: > Apr 14 04:20:03 user devstack@n-api.service[61595]: exception: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:03 user devstack@n-api.service[61595]: action_args: {'id': 'e5344b0d-2d73-40c7-8ac3-535396e985a4'} Apr 14 04:20:03 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. Apr 14 04:20:03 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:03 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] Returning 404 to user: Instance e5344b0d-2d73-40c7-8ac3-535396e985a4 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:03 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-c5f3d792-ae33-479d-a06b-ea47f9968173 tempest-AttachSCSIVolumeTestJSON-1503158328 tempest-AttachSCSIVolumeTestJSON-1503158328-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4" status: 404 len: 111 microversion: 2.1 time: 0.037706 Apr 14 04:20:03 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 85/258] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:02 2023] GET /compute/v2.1/servers/e5344b0d-2d73-40c7-8ac3-535396e985a4 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:20:03 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-unplugged", "status": "completed", "tag": "60579bc4-de13-48d7-b42d-2b9fc5597e45"}, {"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-plugged", "status": "completed", "tag": "60579bc4-de13-48d7-b42d-2b9fc5597e45"}, {"server_uuid": "8ed1dea8-e48a-49f7-924e-82cf639a1677", "name": "network-vif-deleted", "tag": "60579bc4-de13-48d7-b42d-2b9fc5597e45"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] Creating event network-vif-unplugged:60579bc4-de13-48d7-b42d-2b9fc5597e45 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:20:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] Creating event network-vif-plugged:60579bc4-de13-48d7-b42d-2b9fc5597e45 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:20:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] Creating event network-vif-deleted:60579bc4-de13-48d7-b42d-2b9fc5597e45 for instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 on user Apr 14 04:20:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-2deedece-3fd8-46bc-95d4-f86b7582f8da req-af0a57c8-29f0-4a89-be6e-1753742e4fe2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.045018 Apr 14 04:20:04 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 86/259] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:03 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-705757103"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:04 user devstack@n-api.service[61596]: INFO nova.network.security_group_api [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Adding security group 80b8092d-a2e1-43dd-8b7b-3f7f1328a80e to port ef7670a9-3421-45de-a1cd-976ddb46f2a1 Apr 14 04:20:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5fdd53a9-6080-4489-ac9a-a4e1ef5f18d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.787708 Apr 14 04:20:04 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 89/260] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:20:04 2023] POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/action => generated 0 bytes in 789 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:04 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-d19708c9-980c-4225-aa59-8e051ca21566 req-282e88a7-7b06-45d3-bd86-74dbb68bebd2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d19708c9-980c-4225-aa59-8e051ca21566 req-282e88a7-7b06-45d3-bd86-74dbb68bebd2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d19708c9-980c-4225-aa59-8e051ca21566 req-282e88a7-7b06-45d3-bd86-74dbb68bebd2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d19708c9-980c-4225-aa59-8e051ca21566 req-282e88a7-7b06-45d3-bd86-74dbb68bebd2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-d19708c9-980c-4225-aa59-8e051ca21566 req-282e88a7-7b06-45d3-bd86-74dbb68bebd2 service nova] Creating event network-changed:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:20:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-d19708c9-980c-4225-aa59-8e051ca21566 req-282e88a7-7b06-45d3-bd86-74dbb68bebd2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031715 Apr 14 04:20:04 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 87/261] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:05 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-8d16f0f6-dc8d-4961-93ab-47e70d75a660 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1744 microversion: 2.1 time: 0.313114 Apr 14 04:20:05 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 86/262] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:04 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1744 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:06 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:20:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-908dab50-c367-4b55-a64b-a33de7f941b7 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964" status: 204 len: 0 microversion: 2.1 time: 0.135705 Apr 14 04:20:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 90/263] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:20:06 2023] DELETE /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:06 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-57f4049a-061e-4811-a59b-f5e7331d0d54 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964" status: 200 len: 1499 microversion: 2.1 time: 0.238919 Apr 14 04:20:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 88/264] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:06 2023] GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 => generated 1499 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:20:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-c1379301-daa2-4363-a814-e8f558b2e3c9 req-ba547b6f-d6da-4f77-8f79-c6cdab9fdd29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e547de-a74b-4ccd-90de-e7b61cba6964", "name": "network-vif-unplugged", "status": "completed", "tag": "de9378d0-c63f-48c3-9a25-e7d82b8c0f99"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c1379301-daa2-4363-a814-e8f558b2e3c9 req-ba547b6f-d6da-4f77-8f79-c6cdab9fdd29 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c1379301-daa2-4363-a814-e8f558b2e3c9 req-ba547b6f-d6da-4f77-8f79-c6cdab9fdd29 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c1379301-daa2-4363-a814-e8f558b2e3c9 req-ba547b6f-d6da-4f77-8f79-c6cdab9fdd29 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-c1379301-daa2-4363-a814-e8f558b2e3c9 req-ba547b6f-d6da-4f77-8f79-c6cdab9fdd29 service nova] Creating event network-vif-unplugged:de9378d0-c63f-48c3-9a25-e7d82b8c0f99 for instance 59e547de-a74b-4ccd-90de-e7b61cba6964 on user Apr 14 04:20:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-c1379301-daa2-4363-a814-e8f558b2e3c9 req-ba547b6f-d6da-4f77-8f79-c6cdab9fdd29 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037055 Apr 14 04:20:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 87/265] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:06 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-5c7aaea5-2cb3-4d34-9227-6f063e325491 req-eee2fd55-d004-4b1f-b4b2-110a4617321e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e547de-a74b-4ccd-90de-e7b61cba6964", "name": "network-vif-deleted", "tag": "de9378d0-c63f-48c3-9a25-e7d82b8c0f99"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5c7aaea5-2cb3-4d34-9227-6f063e325491 req-eee2fd55-d004-4b1f-b4b2-110a4617321e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5c7aaea5-2cb3-4d34-9227-6f063e325491 req-eee2fd55-d004-4b1f-b4b2-110a4617321e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5c7aaea5-2cb3-4d34-9227-6f063e325491 req-eee2fd55-d004-4b1f-b4b2-110a4617321e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5c7aaea5-2cb3-4d34-9227-6f063e325491 req-eee2fd55-d004-4b1f-b4b2-110a4617321e service nova] Creating event network-vif-deleted:de9378d0-c63f-48c3-9a25-e7d82b8c0f99 for instance 59e547de-a74b-4ccd-90de-e7b61cba6964 on user Apr 14 04:20:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-5c7aaea5-2cb3-4d34-9227-6f063e325491 req-eee2fd55-d004-4b1f-b4b2-110a4617321e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040817 Apr 14 04:20:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 91/266] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "HARD"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ea58aad2-8619-4ec0-8f90-6e790524b911 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.098694 Apr 14 04:20:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 89/267] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:20:08 2023] POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:08 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-818a04a2-e679-4b04-b93d-db3ff1c69ec0 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1746 microversion: 2.1 time: 0.236631 Apr 14 04:20:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 88/268] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:08 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1746 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-d124ca1d-ff89-4700-b646-e0ef41835101 req-8a59cf03-317e-47cc-9bb2-a758805dbc5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "59e547de-a74b-4ccd-90de-e7b61cba6964", "name": "network-vif-plugged", "status": "completed", "tag": "de9378d0-c63f-48c3-9a25-e7d82b8c0f99"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-d124ca1d-ff89-4700-b646-e0ef41835101 req-8a59cf03-317e-47cc-9bb2-a758805dbc5b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-d124ca1d-ff89-4700-b646-e0ef41835101 req-8a59cf03-317e-47cc-9bb2-a758805dbc5b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-d124ca1d-ff89-4700-b646-e0ef41835101 req-8a59cf03-317e-47cc-9bb2-a758805dbc5b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-d124ca1d-ff89-4700-b646-e0ef41835101 req-8a59cf03-317e-47cc-9bb2-a758805dbc5b service nova] Creating event network-vif-plugged:de9378d0-c63f-48c3-9a25-e7d82b8c0f99 for instance 59e547de-a74b-4ccd-90de-e7b61cba6964 on user Apr 14 04:20:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-d124ca1d-ff89-4700-b646-e0ef41835101 req-8a59cf03-317e-47cc-9bb2-a758805dbc5b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 Apr 14 04:20:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 92/269] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:09 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0d5302d3-b05d-40be-9759-15b5995dc813 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Action: 'create', calling method: .version_select at 0x7f538af1e830>, body: {"keypair": {"name": "tempest-keypair-489103115", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhfowbNeLBPLrfbqc+PhVghsx2O4QBgG+5Dt4S+mi9KWhCc2XAzzmjd1lHve17iuHYGnqOklxHT1/98oRwn+cDqXux6c/KdzPdG0zM44c8lW6RgvHpOzy6/wjcQqM6ouQ=="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:09 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-0d5302d3-b05d-40be-9759-15b5995dc813 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Getting quotas for project 3162a049880f4b85afda331443cf52f1. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:20:09 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-0d5302d3-b05d-40be-9759-15b5995dc813 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Getting quotas for user 3537afcf5a3e47deb53acb34d00e0e83 and project 3162a049880f4b85afda331443cf52f1. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:20:09 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0d5302d3-b05d-40be-9759-15b5995dc813 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.32 time: 0.047584 Apr 14 04:20:09 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 90/270] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 04:20:09 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 04:20:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-21aa1605-b0ca-49af-8f01-af03c3980b2f req-65d515d8-5226-4b76-bd6e-9bcc799b4371 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-unplugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}, {"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-plugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-21aa1605-b0ca-49af-8f01-af03c3980b2f req-65d515d8-5226-4b76-bd6e-9bcc799b4371 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-21aa1605-b0ca-49af-8f01-af03c3980b2f req-65d515d8-5226-4b76-bd6e-9bcc799b4371 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-21aa1605-b0ca-49af-8f01-af03c3980b2f req-65d515d8-5226-4b76-bd6e-9bcc799b4371 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-21aa1605-b0ca-49af-8f01-af03c3980b2f req-65d515d8-5226-4b76-bd6e-9bcc799b4371 service nova] Creating event network-vif-unplugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:20:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-21aa1605-b0ca-49af-8f01-af03c3980b2f req-65d515d8-5226-4b76-bd6e-9bcc799b4371 service nova] Creating event network-vif-plugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:20:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-21aa1605-b0ca-49af-8f01-af03c3980b2f req-65d515d8-5226-4b76-bd6e-9bcc799b4371 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.029560 Apr 14 04:20:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 89/271] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:10 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:11 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-device-tagging-server-313960955", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "config_drive": true, "networks": [{"uuid": "75bed293-1d30-421a-9656-15f0ead0650b"}, {"port": "186b0001-a3cf-40fa-babf-6b7045fbdb26", "tag": "port-1"}, {"port": "70e5d70d-d9af-4853-9de8-2cbff2433c60", "tag": "port-2"}, {"uuid": "da4ee7a9-dc57-4a23-9799-18b5841681e0", "tag": "net-1"}, {"uuid": "da4ee7a9-dc57-4a23-9799-18b5841681e0"}, {"uuid": "a12c4e78-0287-4d38-83b1-addfcd1f4315", "fixed_ip": "10.2.2.100", "tag": "net-2-100"}, {"uuid": "a12c4e78-0287-4d38-83b1-addfcd1f4315", "fixed_ip": "10.2.2.200", "tag": "net-2-200"}], "block_device_mapping_v2": [{"uuid": "f2d01790-bd9f-4eff-aa4d-2248429aeb94", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "tag": "boot"}, {"uuid": "40e8dfdd-c6e4-4f7f-a465-913fe79829ac", "source_type": "volume", "destination_type": "volume", "boot_index": 1, "tag": "other"}, {"uuid": "5e5988ce-8d0a-49a0-acc8-84f7d3917bd3", "source_type": "volume", "destination_type": "volume", "boot_index": 2}], "security_groups": [{"name": "tempest-securitygroup--2017310849"}], "key_name": "tempest-keypair-489103115", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:11 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] validate_networks() for [('75bed293-1d30-421a-9656-15f0ead0650b', None, None, None, None, None), (None, None, '186b0001-a3cf-40fa-babf-6b7045fbdb26', None, None, None), (None, None, '70e5d70d-d9af-4853-9de8-2cbff2433c60', None, None, None), ('da4ee7a9-dc57-4a23-9799-18b5841681e0', None, None, None, None, None), ('da4ee7a9-dc57-4a23-9799-18b5841681e0', None, None, None, None, None), ('a12c4e78-0287-4d38-83b1-addfcd1f4315', '10.2.2.100', None, None, None, None), ('a12c4e78-0287-4d38-83b1-addfcd1f4315', '10.2.2.200', None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Getting quotas for project 3162a049880f4b85afda331443cf52f1. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:20:13 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Getting quotas for user 3537afcf5a3e47deb53acb34d00e0e83 and project 3162a049880f4b85afda331443cf52f1. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:20:14 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:20:14 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='boot',updated_at=,uuid=,volume_id='f2d01790-bd9f-4eff-aa4d-2248429aeb94',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=1,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag='other',updated_at=,uuid=,volume_id='40e8dfdd-c6e4-4f7f-a465-913fe79829ac',volume_size=None,volume_type=None), BlockDeviceMapping(attachment_id=,boot_index=2,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='5e5988ce-8d0a-49a0-acc8-84f7d3917bd3',volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:20:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-69db8ff5-362b-49ca-a9f2-187335826bb5 req-da68d0c0-7d2f-44f0-93ed-22e793ef7b4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-plugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-69db8ff5-362b-49ca-a9f2-187335826bb5 req-da68d0c0-7d2f-44f0-93ed-22e793ef7b4b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-69db8ff5-362b-49ca-a9f2-187335826bb5 req-da68d0c0-7d2f-44f0-93ed-22e793ef7b4b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-69db8ff5-362b-49ca-a9f2-187335826bb5 req-da68d0c0-7d2f-44f0-93ed-22e793ef7b4b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-69db8ff5-362b-49ca-a9f2-187335826bb5 req-da68d0c0-7d2f-44f0-93ed-22e793ef7b4b service nova] Creating event network-vif-plugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:20:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-69db8ff5-362b-49ca-a9f2-187335826bb5 req-da68d0c0-7d2f-44f0-93ed-22e793ef7b4b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041099 Apr 14 04:20:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 91/272] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:14 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-fa66ca35-638b-4ad2-a9b7-15c35d09b774 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.32 time: 2.955275 Apr 14 04:20:14 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 93/273] 10.0.0.210 () {66 vars in 1266 bytes} [Fri Apr 14 04:20:11 2023] POST /compute/v2.1/servers => generated 404 bytes in 2957 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:20:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a9afd12a-35f9-4fcd-98f6-90b17eca99d5 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:14 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-a9afd12a-35f9-4fcd-98f6-90b17eca99d5 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:14 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-a9afd12a-35f9-4fcd-98f6-90b17eca99d5 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:14 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-a9afd12a-35f9-4fcd-98f6-90b17eca99d5 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:14 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-a9afd12a-35f9-4fcd-98f6-90b17eca99d5 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a9afd12a-35f9-4fcd-98f6-90b17eca99d5 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 200 len: 1278 microversion: 2.32 time: 0.128483 Apr 14 04:20:14 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 90/274] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:20:14 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 1278 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:20:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-ee892612-aa60-4470-ac7d-265e43d0f80c req-75860c08-b20b-4562-a0ae-dec9b46fb12b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-plugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ee892612-aa60-4470-ac7d-265e43d0f80c req-75860c08-b20b-4562-a0ae-dec9b46fb12b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ee892612-aa60-4470-ac7d-265e43d0f80c req-75860c08-b20b-4562-a0ae-dec9b46fb12b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ee892612-aa60-4470-ac7d-265e43d0f80c req-75860c08-b20b-4562-a0ae-dec9b46fb12b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-ee892612-aa60-4470-ac7d-265e43d0f80c req-75860c08-b20b-4562-a0ae-dec9b46fb12b service nova] Creating event network-vif-plugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:20:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-ee892612-aa60-4470-ac7d-265e43d0f80c req-75860c08-b20b-4562-a0ae-dec9b46fb12b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040171 Apr 14 04:20:16 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 92/275] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:20:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-e9a9359c-d2d2-4023-b916-b8dee7466ba1 req-48d69f85-52a9-4056-8cb9-8ef19d1f645e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "42a38c57-4357-4a88-91e3-d76bb38534db"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-e9a9359c-d2d2-4023-b916-b8dee7466ba1 req-48d69f85-52a9-4056-8cb9-8ef19d1f645e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-e9a9359c-d2d2-4023-b916-b8dee7466ba1 req-48d69f85-52a9-4056-8cb9-8ef19d1f645e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-e9a9359c-d2d2-4023-b916-b8dee7466ba1 req-48d69f85-52a9-4056-8cb9-8ef19d1f645e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-e9a9359c-d2d2-4023-b916-b8dee7466ba1 req-48d69f85-52a9-4056-8cb9-8ef19d1f645e service nova] Creating event network-changed:42a38c57-4357-4a88-91e3-d76bb38534db for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-e9a9359c-d2d2-4023-b916-b8dee7466ba1 req-48d69f85-52a9-4056-8cb9-8ef19d1f645e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041888 Apr 14 04:20:22 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 94/276] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:22 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:24 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-e73c29ea-bc1e-4071-9c9d-fa7b325e3cff req-934a90ec-d3e7-4009-ba22-d200fffc3177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "186b0001-a3cf-40fa-babf-6b7045fbdb26"}, {"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "70e5d70d-d9af-4853-9de8-2cbff2433c60"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:24 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e73c29ea-bc1e-4071-9c9d-fa7b325e3cff req-934a90ec-d3e7-4009-ba22-d200fffc3177 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e73c29ea-bc1e-4071-9c9d-fa7b325e3cff req-934a90ec-d3e7-4009-ba22-d200fffc3177 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e73c29ea-bc1e-4071-9c9d-fa7b325e3cff req-934a90ec-d3e7-4009-ba22-d200fffc3177 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:24 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e73c29ea-bc1e-4071-9c9d-fa7b325e3cff req-934a90ec-d3e7-4009-ba22-d200fffc3177 service nova] Creating event network-changed:186b0001-a3cf-40fa-babf-6b7045fbdb26 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:24 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e73c29ea-bc1e-4071-9c9d-fa7b325e3cff req-934a90ec-d3e7-4009-ba22-d200fffc3177 service nova] Creating event network-changed:70e5d70d-d9af-4853-9de8-2cbff2433c60 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:24 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-e73c29ea-bc1e-4071-9c9d-fa7b325e3cff req-934a90ec-d3e7-4009-ba22-d200fffc3177 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060124 Apr 14 04:20:24 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 91/277] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:24 2023] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:26 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:26 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-10c540a2-d3e0-4f38-b3b0-886de8e1ff0b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 200 len: 1505 microversion: 2.1 time: 0.297016 Apr 14 04:20:26 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 93/278] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:26 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 1505 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:26 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:26 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:26 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "8bfa317e-3995-442d-b5ab-cb1199cb1fb8"}, {"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "97ba6e98-092c-472f-9f27-eab96fe7f9ae"}, {"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "62770b99-cf54-4132-ad17-d1859ddf8443"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] Creating event network-changed:8bfa317e-3995-442d-b5ab-cb1199cb1fb8 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] Creating event network-changed:97ba6e98-092c-472f-9f27-eab96fe7f9ae for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] Creating event network-changed:62770b99-cf54-4132-ad17-d1859ddf8443 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-35c24a45-932e-4278-8d49-f62e8c260e8d req-ad40ff8e-73d0-4a1a-acdb-732fe011d4e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 513 microversion: 2.1 time: 0.035210 Apr 14 04:20:26 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 95/279] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:26 2023] POST /compute/v2.1/os-server-external-events => generated 513 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] HTTP exception thrown: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Request method failure captured: Apr 14 04:20:27 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 HTTP/1.1 Apr 14 04:20:27 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:20:27 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:20:27 user devstack@n-api.service[61595]: Connection: close Apr 14 04:20:27 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:20:27 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:20:27 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:20:27 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:20:27 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOqvVBeMS6zEdxl7X8I8RhhZixN5paEvN9hWX9xM2K8mRv9jjTswBlpd6gxKj9yta2Cq9aBOCGyJnYJos0SHmvNKc1snwtjoRQu_8CnbhSg_w1f8MUfg90KV6uQnCyUnBqYtvZ4GlRw2VB04D8FDQsR7m14nIOESdZW8L0FChsn9Dk Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Project-Id: 225e61ca983d4f27adc61ad33c81fce4 Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/225e61ca983d4f27adc61ad33c81fce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/225e61ca983d4f27adc61ad33c81fce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/225e61ca983d4f27adc61ad33c81fce4"}]}] Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Tenant: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Tenant-Id: 225e61ca983d4f27adc61ad33c81fce4 Apr 14 04:20:27 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:27 user devstack@n-api.service[61595]: X-User: tempest-TaggedBootDevicesTest_v242-581315356-project-member Apr 14 04:20:27 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:20:27 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:20:27 user devstack@n-api.service[61595]: X-User-Id: b848680106b74275a947f316ce6311fd Apr 14 04:20:27 user devstack@n-api.service[61595]: X-User-Name: tempest-TaggedBootDevicesTest_v242-581315356-project-member Apr 14 04:20:27 user devstack@n-api.service[61595]: method: > Apr 14 04:20:27 user devstack@n-api.service[61595]: exception: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:27 user devstack@n-api.service[61595]: action_args: {'id': '55ba1cae-2b2f-43de-86db-996a8791fb02'} Apr 14 04:20:27 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:27 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Returning 404 to user: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:27 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2ca877cb-35cc-4aea-8d76-e78c9d83b57f tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 404 len: 111 microversion: 2.42 time: 0.035453 Apr 14 04:20:27 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 92/280] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:20:27 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e4caaa54-dc20-4abf-9d5b-2e2b78591c93 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '.version_select at 0x7f538b15dfc0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e4caaa54-dc20-4abf-9d5b-2e2b78591c93 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-475824842" status: 204 len: 0 microversion: 2.42 time: 0.049542 Apr 14 04:20:27 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 94/281] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 04:20:27 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-475824842 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ee8968e5-91ad-4d32-bc29-3630324a6118 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ee8968e5-91ad-4d32-bc29-3630324a6118 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ee8968e5-91ad-4d32-bc29-3630324a6118 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ee8968e5-91ad-4d32-bc29-3630324a6118 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ee8968e5-91ad-4d32-bc29-3630324a6118 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Going to try to start instance {{(pid=61596) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 04:20:27 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ee8968e5-91ad-4d32-bc29-3630324a6118 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action" status: 202 len: 0 microversion: 2.1 time: 0.122252 Apr 14 04:20:27 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 96/282] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:20:27 2023] POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0f4a173a-fd8d-40ed-af0c-cd6eafecb04e tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.067122 Apr 14 04:20:27 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 95/283] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:20:27 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7/os-volume_attachments => generated 25 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:20:27 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-affa44f7-7a95-4adb-b1ec-5aa427a1ec5a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1699 microversion: 2.1 time: 0.463976 Apr 14 04:20:27 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 93/284] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:27 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1699 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:27 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:20:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-83d7a229-1428-4277-b7de-4a4327dd81c2 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7" status: 204 len: 0 microversion: 2.1 time: 0.147583 Apr 14 04:20:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 97/285] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:20:27 2023] DELETE /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1da030e7c9e44f9b82f3286378a2ede6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ffadee5eeb7f4b42ae93e2e2578ef897', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2d8795b6-0b87-481c-bc38-9115e8546590 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7" status: 200 len: 1648 microversion: 2.1 time: 0.564540 Apr 14 04:20:28 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 96/286] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:28 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 => generated 1648 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-15ed8115-a241-4f1f-9eac-785dedb64fdf req-04b84fd0-8ad3-4791-835e-95c747bb08bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "7249969b-00f8-4c4d-8573-832c3e0eb8fe"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=50,nova_api:DELETE=1,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-15ed8115-a241-4f1f-9eac-785dedb64fdf req-04b84fd0-8ad3-4791-835e-95c747bb08bb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-15ed8115-a241-4f1f-9eac-785dedb64fdf req-04b84fd0-8ad3-4791-835e-95c747bb08bb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-15ed8115-a241-4f1f-9eac-785dedb64fdf req-04b84fd0-8ad3-4791-835e-95c747bb08bb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-15ed8115-a241-4f1f-9eac-785dedb64fdf req-04b84fd0-8ad3-4791-835e-95c747bb08bb service nova] Creating event network-changed:7249969b-00f8-4c4d-8573-832c3e0eb8fe for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-15ed8115-a241-4f1f-9eac-785dedb64fdf req-04b84fd0-8ad3-4791-835e-95c747bb08bb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033155 Apr 14 04:20:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 98/287] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:28 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-463798be-c3cf-410a-9297-8d878a1f7e36 req-06f04fc2-a88f-4e61-8462-a9eaaf19cd11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7", "name": "network-vif-unplugged", "status": "completed", "tag": "3f178241-75e2-4e0a-8d92-e647d05ed85e"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-463798be-c3cf-410a-9297-8d878a1f7e36 req-06f04fc2-a88f-4e61-8462-a9eaaf19cd11 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-463798be-c3cf-410a-9297-8d878a1f7e36 req-06f04fc2-a88f-4e61-8462-a9eaaf19cd11 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-463798be-c3cf-410a-9297-8d878a1f7e36 req-06f04fc2-a88f-4e61-8462-a9eaaf19cd11 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-463798be-c3cf-410a-9297-8d878a1f7e36 req-06f04fc2-a88f-4e61-8462-a9eaaf19cd11 service nova] Creating event network-vif-unplugged:3f178241-75e2-4e0a-8d92-e647d05ed85e for instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 on user Apr 14 04:20:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-463798be-c3cf-410a-9297-8d878a1f7e36 req-06f04fc2-a88f-4e61-8462-a9eaaf19cd11 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030757 Apr 14 04:20:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 99/288] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:28 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-94dd0f9b-4697-4e0c-88a0-eafe04b1a2fd tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Action: 'create', calling method: .version_select at 0x7f538aff6170>, body: {"keypair": {"name": "tempest-keypair-1913633949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLbK9oP2daoZ7CXzxqtKBII/FQaajUVtxz7jBM0XYl4vW+UAcK//Iu4dDRXCklmwqWmqltHv3bFd4W3dO1IesZBh1iAMKvrzpnwuq9+FegSMWhSVQUKbRRtM51bR4jMkw=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:28 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:28 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-94dd0f9b-4697-4e0c-88a0-eafe04b1a2fd tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Getting quotas for project 3d389bb78d2e40b9b07d2d3ecdb7566b. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:20:28 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-94dd0f9b-4697-4e0c-88a0-eafe04b1a2fd tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Getting quotas for user d2561bbc0c6d447da333ffdbb9fdc5f4 and project 3d389bb78d2e40b9b07d2d3ecdb7566b. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:20:28 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-94dd0f9b-4697-4e0c-88a0-eafe04b1a2fd tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.315452 Apr 14 04:20:28 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 94/289] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:20:28 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:29 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-11002518-7706-4011-979b-6e954a178aef tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1656 microversion: 2.1 time: 0.433066 Apr 14 04:20:29 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 97/290] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:28 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1656 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3e0082ad-1ad0-4980-a066-6017f65fce9e"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:29 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-68d3d448-ac20-4492-90c6-0067a190395f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.465289 Apr 14 04:20:29 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 100/291] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:20:29 2023] POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments => generated 194 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:30 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-d551fc2d-0d05-4606-b8b4-060685db7efb req-58769db3-e4c5-408d-90d6-9b28f63901b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7", "name": "network-vif-deleted", "tag": "3f178241-75e2-4e0a-8d92-e647d05ed85e"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-d551fc2d-0d05-4606-b8b4-060685db7efb req-58769db3-e4c5-408d-90d6-9b28f63901b8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-d551fc2d-0d05-4606-b8b4-060685db7efb req-58769db3-e4c5-408d-90d6-9b28f63901b8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-d551fc2d-0d05-4606-b8b4-060685db7efb req-58769db3-e4c5-408d-90d6-9b28f63901b8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:30 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-d551fc2d-0d05-4606-b8b4-060685db7efb req-58769db3-e4c5-408d-90d6-9b28f63901b8 service nova] Creating event network-vif-deleted:3f178241-75e2-4e0a-8d92-e647d05ed85e for instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 on user Apr 14 04:20:30 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-d551fc2d-0d05-4606-b8b4-060685db7efb req-58769db3-e4c5-408d-90d6-9b28f63901b8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041730 Apr 14 04:20:30 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 95/292] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:30 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-cfbafd6f-2478-4177-bd74-1f8fc6b49863 req-6f3f9d09-48b4-4f24-a96e-34dac76c284d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7", "name": "network-vif-plugged", "status": "completed", "tag": "3f178241-75e2-4e0a-8d92-e647d05ed85e"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cfbafd6f-2478-4177-bd74-1f8fc6b49863 req-6f3f9d09-48b4-4f24-a96e-34dac76c284d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cfbafd6f-2478-4177-bd74-1f8fc6b49863 req-6f3f9d09-48b4-4f24-a96e-34dac76c284d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cfbafd6f-2478-4177-bd74-1f8fc6b49863 req-6f3f9d09-48b4-4f24-a96e-34dac76c284d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:30 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-cfbafd6f-2478-4177-bd74-1f8fc6b49863 req-6f3f9d09-48b4-4f24-a96e-34dac76c284d service nova] Creating event network-vif-plugged:3f178241-75e2-4e0a-8d92-e647d05ed85e for instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 on user Apr 14 04:20:30 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-cfbafd6f-2478-4177-bd74-1f8fc6b49863 req-6f3f9d09-48b4-4f24-a96e-34dac76c284d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032531 Apr 14 04:20:30 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 98/293] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1275756548", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "617ed49c-d627-4bde-8573-e645f06f34b2"}], "security_groups": [{"name": "tempest-securitygroup--1423643681"}], "key_name": "tempest-keypair-1913633949", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] validate_networks() for [('617ed49c-d627-4bde-8573-e645f06f34b2', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Getting quotas for project 3d389bb78d2e40b9b07d2d3ecdb7566b. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Getting quotas for user d2561bbc0c6d447da333ffdbb9fdc5f4 and project 3d389bb78d2e40b9b07d2d3ecdb7566b. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:20:31 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:20:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ea87d5ee-2625-447d-91ad-9bf7c006290f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.658702 Apr 14 04:20:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 101/294] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:20:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 660 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:20:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-94ba0727-601b-4fdf-86ef-629ebc252461 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:31 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-94ba0727-601b-4fdf-86ef-629ebc252461 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:31 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-94ba0727-601b-4fdf-86ef-629ebc252461 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2561bbc0c6d447da333ffdbb9fdc5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d389bb78d2e40b9b07d2d3ecdb7566b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-94ba0727-601b-4fdf-86ef-629ebc252461 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38" status: 200 len: 1236 microversion: 2.1 time: 0.071503 Apr 14 04:20:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 96/295] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:31 2023] GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38 => generated 1236 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:32 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d80d3684045298d895555247174af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bb9ddec81e4f6cbceb6ce7dee9c3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:32 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d4bba248-3523-4f4a-8e93-53f75b6c2482 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 200 len: 1672 microversion: 2.1 time: 0.558333 Apr 14 04:20:32 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 99/296] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:32 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 1672 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:32 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] HTTP exception thrown: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Request method failure captured: Apr 14 04:20:32 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 HTTP/1.1 Apr 14 04:20:32 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:20:32 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:20:32 user devstack@n-api.service[61596]: Connection: close Apr 14 04:20:32 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:20:32 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:20:32 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:20:32 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:20:32 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOqvVBeMS6zEdxl7X8I8RhhZixN5paEvN9hWX9xM2K8mRv9jjTswBlpd6gxKj9yta2Cq9aBOCGyJnYJos0SHmvNKc1snwtjoRQu_8CnbhSg_w1f8MUfg90KV6uQnCyUnBqYtvZ4GlRw2VB04D8FDQsR7m14nIOESdZW8L0FChsn9Dk Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Project-Id: 225e61ca983d4f27adc61ad33c81fce4 Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/225e61ca983d4f27adc61ad33c81fce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/225e61ca983d4f27adc61ad33c81fce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/225e61ca983d4f27adc61ad33c81fce4"}]}] Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Tenant: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Tenant-Id: 225e61ca983d4f27adc61ad33c81fce4 Apr 14 04:20:32 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:32 user devstack@n-api.service[61596]: X-User: tempest-TaggedBootDevicesTest_v242-581315356-project-member Apr 14 04:20:32 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:20:32 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:20:32 user devstack@n-api.service[61596]: X-User-Id: b848680106b74275a947f316ce6311fd Apr 14 04:20:32 user devstack@n-api.service[61596]: X-User-Name: tempest-TaggedBootDevicesTest_v242-581315356-project-member Apr 14 04:20:32 user devstack@n-api.service[61596]: method: > Apr 14 04:20:32 user devstack@n-api.service[61596]: exception: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61596]: action_args: {'id': '55ba1cae-2b2f-43de-86db-996a8791fb02'} Apr 14 04:20:32 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Returning 404 to user: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:32 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5c5f4bf4-2b88-44c0-9dab-b6aac39f3c83 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 404 len: 111 microversion: 2.42 time: 0.050519 Apr 14 04:20:32 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 102/297] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:20:32 2023] DELETE /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] [instance: 55ba1cae-2b2f-43de-86db-996a8791fb02] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] HTTP exception thrown: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Request method failure captured: Apr 14 04:20:32 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 HTTP/1.1 Apr 14 04:20:32 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:20:32 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:20:32 user devstack@n-api.service[61595]: Connection: close Apr 14 04:20:32 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:20:32 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:20:32 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:20:32 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:20:32 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOqvVBeMS6zEdxl7X8I8RhhZixN5paEvN9hWX9xM2K8mRv9jjTswBlpd6gxKj9yta2Cq9aBOCGyJnYJos0SHmvNKc1snwtjoRQu_8CnbhSg_w1f8MUfg90KV6uQnCyUnBqYtvZ4GlRw2VB04D8FDQsR7m14nIOESdZW8L0FChsn9Dk Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.42 Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Project-Id: 225e61ca983d4f27adc61ad33c81fce4 Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Project-Name: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/225e61ca983d4f27adc61ad33c81fce4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/225e61ca983d4f27adc61ad33c81fce4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/225e61ca983d4f27adc61ad33c81fce4"}]}] Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Tenant: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Tenant-Id: 225e61ca983d4f27adc61ad33c81fce4 Apr 14 04:20:32 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TaggedBootDevicesTest_v242-581315356 Apr 14 04:20:32 user devstack@n-api.service[61595]: X-User: tempest-TaggedBootDevicesTest_v242-581315356-project-member Apr 14 04:20:32 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:20:32 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:20:32 user devstack@n-api.service[61595]: X-User-Id: b848680106b74275a947f316ce6311fd Apr 14 04:20:32 user devstack@n-api.service[61595]: X-User-Name: tempest-TaggedBootDevicesTest_v242-581315356-project-member Apr 14 04:20:32 user devstack@n-api.service[61595]: method: > Apr 14 04:20:32 user devstack@n-api.service[61595]: exception: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61595]: action_args: {'id': '55ba1cae-2b2f-43de-86db-996a8791fb02'} Apr 14 04:20:32 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. Apr 14 04:20:32 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] Returning 404 to user: Instance 55ba1cae-2b2f-43de-86db-996a8791fb02 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0e0b0607-c9f0-4e26-b203-7743b49f6913 tempest-TaggedBootDevicesTest_v242-581315356 tempest-TaggedBootDevicesTest_v242-581315356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02" status: 404 len: 111 microversion: 2.42 time: 0.052823 Apr 14 04:20:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 97/298] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:20:32 2023] GET /compute/v2.1/servers/55ba1cae-2b2f-43de-86db-996a8791fb02 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:20:35 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a21545e0-238f-4187-89d9-3190538910c0 req-6865e67e-4412-4046-8b51-53048efad471 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a21545e0-238f-4187-89d9-3190538910c0 req-6865e67e-4412-4046-8b51-53048efad471 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a21545e0-238f-4187-89d9-3190538910c0 req-6865e67e-4412-4046-8b51-53048efad471 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a21545e0-238f-4187-89d9-3190538910c0 req-6865e67e-4412-4046-8b51-53048efad471 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a21545e0-238f-4187-89d9-3190538910c0 req-6865e67e-4412-4046-8b51-53048efad471 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:20:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a21545e0-238f-4187-89d9-3190538910c0 req-6865e67e-4412-4046-8b51-53048efad471 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083425 Apr 14 04:20:35 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 100/299] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:35 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5ed43b12-12d0-4bd1-8c4a-d85304d8d0eb tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.324016 Apr 14 04:20:36 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 103/300] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:20:36 2023] POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments => generated 194 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-7637a7a1-5fe1-4813-955b-8d2135169398 req-3fe52637-6605-4b74-8189-5efa725a9395 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2e6cf32-080b-47b2-b4db-2b776ba85b38", "tag": "7c8689e1-9c0a-42b6-8cb3-7751f619ba1f"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7637a7a1-5fe1-4813-955b-8d2135169398 req-3fe52637-6605-4b74-8189-5efa725a9395 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7637a7a1-5fe1-4813-955b-8d2135169398 req-3fe52637-6605-4b74-8189-5efa725a9395 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7637a7a1-5fe1-4813-955b-8d2135169398 req-3fe52637-6605-4b74-8189-5efa725a9395 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-7637a7a1-5fe1-4813-955b-8d2135169398 req-3fe52637-6605-4b74-8189-5efa725a9395 service nova] Creating event network-changed:7c8689e1-9c0a-42b6-8cb3-7751f619ba1f for instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 on user Apr 14 04:20:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-7637a7a1-5fe1-4813-955b-8d2135169398 req-3fe52637-6605-4b74-8189-5efa725a9395 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045659 Apr 14 04:20:37 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 98/301] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-e0503345-62b6-4b49-82cd-f4b9418a9c96 req-9196b38b-7568-4dac-91af-14b372673635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0503345-62b6-4b49-82cd-f4b9418a9c96 req-9196b38b-7568-4dac-91af-14b372673635 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0503345-62b6-4b49-82cd-f4b9418a9c96 req-9196b38b-7568-4dac-91af-14b372673635 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0503345-62b6-4b49-82cd-f4b9418a9c96 req-9196b38b-7568-4dac-91af-14b372673635 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-e0503345-62b6-4b49-82cd-f4b9418a9c96 req-9196b38b-7568-4dac-91af-14b372673635 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:20:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-e0503345-62b6-4b49-82cd-f4b9418a9c96 req-9196b38b-7568-4dac-91af-14b372673635 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039385 Apr 14 04:20:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 101/302] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:39 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-ff8adc02-3e40-4aba-976a-60f9b7f91c90 req-3b3ef6b9-1d01-4ee8-9436-d208341b0679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e6cf32-080b-47b2-b4db-2b776ba85b38", "name": "network-vif-plugged", "status": "completed", "tag": "7c8689e1-9c0a-42b6-8cb3-7751f619ba1f"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ff8adc02-3e40-4aba-976a-60f9b7f91c90 req-3b3ef6b9-1d01-4ee8-9436-d208341b0679 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ff8adc02-3e40-4aba-976a-60f9b7f91c90 req-3b3ef6b9-1d01-4ee8-9436-d208341b0679 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ff8adc02-3e40-4aba-976a-60f9b7f91c90 req-3b3ef6b9-1d01-4ee8-9436-d208341b0679 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-ff8adc02-3e40-4aba-976a-60f9b7f91c90 req-3b3ef6b9-1d01-4ee8-9436-d208341b0679 service nova] Creating event network-vif-plugged:7c8689e1-9c0a-42b6-8cb3-7751f619ba1f for instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 on user Apr 14 04:20:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-ff8adc02-3e40-4aba-976a-60f9b7f91c90 req-3b3ef6b9-1d01-4ee8-9436-d208341b0679 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039670 Apr 14 04:20:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 99/303] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:40 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-967382bd-39e8-42c6-a33d-4fe57f5634be tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1702 microversion: 2.1 time: 0.245617 Apr 14 04:20:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 104/304] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:39 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1702 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'action', calling method: >, body: {"rebuild": {"name": "tempest-ServerActionsTestJSON-server-1398117926", "metadata": {"rebuild": "server"}, "adminPass": "***", "imageRef": "}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: dict_keys(['metadata_items']) {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for user e35b3ae371cf4dd4b21e2999e58cd2f4 and project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: dict_keys(['metadata_items']) {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-8fa1968a-9ef4-4862-8abd-d310b36852da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/action" status: 202 len: 1160 microversion: 2.1 time: 0.463032 Apr 14 04:20:40 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 102/305] 10.0.0.210 () {64 vars in 1356 bytes} [Fri Apr 14 04:20:40 2023] POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/action => generated 1160 bytes in 465 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:41 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2a34be89-c19d-41e0-85ea-73d882d38c6c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1730 microversion: 2.1 time: 0.330303 Apr 14 04:20:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 100/306] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:40 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1730 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-81b51ea7-71be-4b12-93bb-987888b7e3c0 req-eeccefb2-41ab-49f3-9032-5d134feae72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:41 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-81b51ea7-71be-4b12-93bb-987888b7e3c0 req-eeccefb2-41ab-49f3-9032-5d134feae72c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-81b51ea7-71be-4b12-93bb-987888b7e3c0 req-eeccefb2-41ab-49f3-9032-5d134feae72c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-81b51ea7-71be-4b12-93bb-987888b7e3c0 req-eeccefb2-41ab-49f3-9032-5d134feae72c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:41 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-81b51ea7-71be-4b12-93bb-987888b7e3c0 req-eeccefb2-41ab-49f3-9032-5d134feae72c service nova] Creating event network-vif-unplugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:20:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-81b51ea7-71be-4b12-93bb-987888b7e3c0 req-eeccefb2-41ab-49f3-9032-5d134feae72c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.052246 Apr 14 04:20:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 105/307] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f60fb214-91a3-4421-b05d-5e5a6de9fdae req-05aab2d5-f942-4e04-a90d-e18fa22fbccb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e6cf32-080b-47b2-b4db-2b776ba85b38", "name": "network-vif-plugged", "status": "completed", "tag": "7c8689e1-9c0a-42b6-8cb3-7751f619ba1f"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f60fb214-91a3-4421-b05d-5e5a6de9fdae req-05aab2d5-f942-4e04-a90d-e18fa22fbccb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f60fb214-91a3-4421-b05d-5e5a6de9fdae req-05aab2d5-f942-4e04-a90d-e18fa22fbccb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f60fb214-91a3-4421-b05d-5e5a6de9fdae req-05aab2d5-f942-4e04-a90d-e18fa22fbccb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f60fb214-91a3-4421-b05d-5e5a6de9fdae req-05aab2d5-f942-4e04-a90d-e18fa22fbccb service nova] Creating event network-vif-plugged:7c8689e1-9c0a-42b6-8cb3-7751f619ba1f for instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 on user Apr 14 04:20:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f60fb214-91a3-4421-b05d-5e5a6de9fdae req-05aab2d5-f942-4e04-a90d-e18fa22fbccb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039770 Apr 14 04:20:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 103/308] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-7a4331ef-0802-4d10-89bc-3fa78f4aee0d req-4975f243-3496-4131-a119-50a6aaae119e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "186b0001-a3cf-40fa-babf-6b7045fbdb26"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:43 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7a4331ef-0802-4d10-89bc-3fa78f4aee0d req-4975f243-3496-4131-a119-50a6aaae119e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7a4331ef-0802-4d10-89bc-3fa78f4aee0d req-4975f243-3496-4131-a119-50a6aaae119e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7a4331ef-0802-4d10-89bc-3fa78f4aee0d req-4975f243-3496-4131-a119-50a6aaae119e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-7a4331ef-0802-4d10-89bc-3fa78f4aee0d req-4975f243-3496-4131-a119-50a6aaae119e service nova] Creating event network-vif-plugged:186b0001-a3cf-40fa-babf-6b7045fbdb26 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-7a4331ef-0802-4d10-89bc-3fa78f4aee0d req-4975f243-3496-4131-a119-50a6aaae119e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052703 Apr 14 04:20:43 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 101/309] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "42a38c57-4357-4a88-91e3-d76bb38534db"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "42a38c57-4357-4a88-91e3-d76bb38534db"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:20:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] Creating event network-vif-plugged:42a38c57-4357-4a88-91e3-d76bb38534db for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] Creating event network-vif-plugged:42a38c57-4357-4a88-91e3-d76bb38534db for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-842f8bb0-9a37-471c-b2be-c36bb319e63e req-7de74eac-c717-4813-a01e-83ba4dfc1663 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.040069 Apr 14 04:20:43 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 106/310] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:43 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:45 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "186b0001-a3cf-40fa-babf-6b7045fbdb26"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "70e5d70d-d9af-4853-9de8-2cbff2433c60"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "70e5d70d-d9af-4853-9de8-2cbff2433c60"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "8bfa317e-3995-442d-b5ab-cb1199cb1fb8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Creating event network-vif-plugged:186b0001-a3cf-40fa-babf-6b7045fbdb26 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Creating event network-vif-plugged:70e5d70d-d9af-4853-9de8-2cbff2433c60 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Creating event network-vif-plugged:70e5d70d-d9af-4853-9de8-2cbff2433c60 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] Creating event network-vif-plugged:8bfa317e-3995-442d-b5ab-cb1199cb1fb8 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-2a716b6c-d063-451d-90bd-a3e8728a0345 req-29839009-922c-4c12-bf0d-9e7a72c0c062 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.048898 Apr 14 04:20:45 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 104/311] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:45 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:45 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "97ba6e98-092c-472f-9f27-eab96fe7f9ae"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "97ba6e98-092c-472f-9f27-eab96fe7f9ae"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "62770b99-cf54-4132-ad17-d1859ddf8443"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "62770b99-cf54-4132-ad17-d1859ddf8443"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "7249969b-00f8-4c4d-8573-832c3e0eb8fe"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:45 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lazy-loading 'flavor' on Instance uuid cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:20:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Creating event network-vif-plugged:97ba6e98-092c-472f-9f27-eab96fe7f9ae for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Creating event network-vif-plugged:97ba6e98-092c-472f-9f27-eab96fe7f9ae for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Creating event network-vif-plugged:62770b99-cf54-4132-ad17-d1859ddf8443 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Creating event network-vif-plugged:62770b99-cf54-4132-ad17-d1859ddf8443 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] Creating event network-vif-plugged:7249969b-00f8-4c4d-8573-832c3e0eb8fe for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-ec8a393f-58b7-4a7c-b034-cb3323fd338e req-929a11cf-abbb-4296-83da-c66e437d5cad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 867 microversion: 2.1 time: 0.185512 Apr 14 04:20:46 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 107/312] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:45 2023] POST /compute/v2.1/os-server-external-events => generated 867 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:20:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-5627d40d-113f-45ab-8a0d-f75b213c3136 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/action" status: 200 len: 29 microversion: 2.1 time: 0.368497 Apr 14 04:20:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 102/313] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:20:45 2023] POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/action => generated 29 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:46 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d80d3684045298d895555247174af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bb9ddec81e4f6cbceb6ce7dee9c3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d112ed10-e31e-4ca0-b991-5ea1fad9e9af tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 200 len: 1724 microversion: 2.1 time: 0.442222 Apr 14 04:20:46 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 105/314] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:46 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 1724 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "8bfa317e-3995-442d-b5ab-cb1199cb1fb8"}, {"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-unplugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] Creating event network-vif-plugged:8bfa317e-3995-442d-b5ab-cb1199cb1fb8 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] Creating event network-vif-unplugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-96a31d5f-250b-49ad-8c27-fd92b88f153a req-7fc8c820-38f2-4aaa-bb9f-8a7f9b4ef785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.079790 Apr 14 04:20:47 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 108/315] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:47 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:48 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-432b49eb-d735-4ce2-9981-39072f7ec358 req-2251e344-f289-486d-a4c2-3ca111fab785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "7249969b-00f8-4c4d-8573-832c3e0eb8fe"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-432b49eb-d735-4ce2-9981-39072f7ec358 req-2251e344-f289-486d-a4c2-3ca111fab785 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-432b49eb-d735-4ce2-9981-39072f7ec358 req-2251e344-f289-486d-a4c2-3ca111fab785 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-432b49eb-d735-4ce2-9981-39072f7ec358 req-2251e344-f289-486d-a4c2-3ca111fab785 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:48 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-432b49eb-d735-4ce2-9981-39072f7ec358 req-2251e344-f289-486d-a4c2-3ca111fab785 service nova] Creating event network-vif-plugged:7249969b-00f8-4c4d-8573-832c3e0eb8fe for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:20:48 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-432b49eb-d735-4ce2-9981-39072f7ec358 req-2251e344-f289-486d-a4c2-3ca111fab785 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042869 Apr 14 04:20:48 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 103/316] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:49 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-unplugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Creating event network-vif-unplugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-592f97de-66ec-4d0f-83f4-8a7cd012e79b req-928af76e-6e77-471c-a5d1-25824029346c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 698 microversion: 2.1 time: 0.053096 Apr 14 04:20:49 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 106/317] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:49 2023] POST /compute/v2.1/os-server-external-events => generated 698 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f9785589-26ea-4e09-8ac3-529a799f68b6 req-dc082257-de0c-4d2c-8d01-eebedb8fabff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] HTTP exception thrown: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Request method failure captured: Apr 14 04:20:52 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 HTTP/1.1 Apr 14 04:20:52 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:20:52 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:20:52 user devstack@n-api.service[61596]: Connection: close Apr 14 04:20:52 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:20:52 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:20:52 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:20:52 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:20:52 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOW7OGuq-LmAu8uStQ57PQC65meARzAx6F2EZ814NyPLVuD5CYGxxrwMB8hFt5XipU04111UX9id5oRJBNz3cKH-Xyhr94eGyFupA0KUob5YTGvND0FyyiR_ArD-83XRLpOwe3k7GwKa8MGVtHWU-zbYUH5BJxO-yAqgurIsJ60XD0 Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Project-Id: 01cefa66350a4432ad71204b39e953be Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Project-Name: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01cefa66350a4432ad71204b39e953be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01cefa66350a4432ad71204b39e953be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01cefa66350a4432ad71204b39e953be"}]}] Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Tenant: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Tenant-Id: 01cefa66350a4432ad71204b39e953be Apr 14 04:20:52 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:52 user devstack@n-api.service[61596]: X-User: tempest-TaggedAttachmentsTest-926384577-project-member Apr 14 04:20:52 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:20:52 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:20:52 user devstack@n-api.service[61596]: X-User-Id: 0aeeeae7cbc340daa8cd81c1418794e0 Apr 14 04:20:52 user devstack@n-api.service[61596]: X-User-Name: tempest-TaggedAttachmentsTest-926384577-project-member Apr 14 04:20:52 user devstack@n-api.service[61596]: method: > Apr 14 04:20:52 user devstack@n-api.service[61596]: exception: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:52 user devstack@n-api.service[61596]: action_args: {'id': '8ed1dea8-e48a-49f7-924e-82cf639a1677'} Apr 14 04:20:52 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:52 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:20:52 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Returning 404 to user: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-57096d5b-79fb-4ed5-8642-1fb400ded1d7 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 404 len: 111 microversion: 2.49 time: 0.048472 Apr 14 04:20:52 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 109/318] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:20:52 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:20:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f9785589-26ea-4e09-8ac3-529a799f68b6 req-dc082257-de0c-4d2c-8d01-eebedb8fabff service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4b920b7f-b9ce-4f31-8945-f2cf72dd589b tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '.version_select at 0x7f538aed56c0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f9785589-26ea-4e09-8ac3-529a799f68b6 req-dc082257-de0c-4d2c-8d01-eebedb8fabff service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f9785589-26ea-4e09-8ac3-529a799f68b6 req-dc082257-de0c-4d2c-8d01-eebedb8fabff service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f9785589-26ea-4e09-8ac3-529a799f68b6 req-dc082257-de0c-4d2c-8d01-eebedb8fabff service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f9785589-26ea-4e09-8ac3-529a799f68b6 req-dc082257-de0c-4d2c-8d01-eebedb8fabff service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080225 Apr 14 04:20:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 104/319] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4b920b7f-b9ce-4f31-8945-f2cf72dd589b tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-330344245" status: 204 len: 0 microversion: 2.49 time: 0.046791 Apr 14 04:20:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 107/320] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 04:20:52 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-330344245 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-41e6683a-4399-418a-b065-b5c00e4abc21 req-888556f7-a333-4f89-b1ba-b2053fc82b21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-41e6683a-4399-418a-b065-b5c00e4abc21 req-888556f7-a333-4f89-b1ba-b2053fc82b21 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-41e6683a-4399-418a-b065-b5c00e4abc21 req-888556f7-a333-4f89-b1ba-b2053fc82b21 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-41e6683a-4399-418a-b065-b5c00e4abc21 req-888556f7-a333-4f89-b1ba-b2053fc82b21 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-41e6683a-4399-418a-b065-b5c00e4abc21 req-888556f7-a333-4f89-b1ba-b2053fc82b21 service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:20:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-41e6683a-4399-418a-b065-b5c00e4abc21 req-888556f7-a333-4f89-b1ba-b2053fc82b21 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035309 Apr 14 04:20:54 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 110/321] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] HTTP exception thrown: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Request method failure captured: Apr 14 04:20:54 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 HTTP/1.1 Apr 14 04:20:54 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:20:54 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:20:54 user devstack@n-api.service[61595]: Connection: close Apr 14 04:20:54 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:20:54 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:20:54 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:20:54 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:20:54 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOW7OGuq-LmAu8uStQ57PQC65meARzAx6F2EZ814NyPLVuD5CYGxxrwMB8hFt5XipU04111UX9id5oRJBNz3cKH-Xyhr94eGyFupA0KUob5YTGvND0FyyiR_ArD-83XRLpOwe3k7GwKa8MGVtHWU-zbYUH5BJxO-yAqgurIsJ60XD0 Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Project-Id: 01cefa66350a4432ad71204b39e953be Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Project-Name: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01cefa66350a4432ad71204b39e953be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01cefa66350a4432ad71204b39e953be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01cefa66350a4432ad71204b39e953be"}]}] Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Tenant: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Tenant-Id: 01cefa66350a4432ad71204b39e953be Apr 14 04:20:54 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:54 user devstack@n-api.service[61595]: X-User: tempest-TaggedAttachmentsTest-926384577-project-member Apr 14 04:20:54 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:20:54 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:20:54 user devstack@n-api.service[61595]: X-User-Id: 0aeeeae7cbc340daa8cd81c1418794e0 Apr 14 04:20:54 user devstack@n-api.service[61595]: X-User-Name: tempest-TaggedAttachmentsTest-926384577-project-member Apr 14 04:20:54 user devstack@n-api.service[61595]: method: > Apr 14 04:20:54 user devstack@n-api.service[61595]: exception: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61595]: action_args: {'id': '8ed1dea8-e48a-49f7-924e-82cf639a1677'} Apr 14 04:20:54 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Returning 404 to user: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0c1f9190-5f60-4fab-a3ec-a38e0818acf6 tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 404 len: 111 microversion: 2.49 time: 0.039424 Apr 14 04:20:54 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 105/322] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:20:54 2023] DELETE /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] [instance: 8ed1dea8-e48a-49f7-924e-82cf639a1677] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] HTTP exception thrown: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Request method failure captured: Apr 14 04:20:54 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 HTTP/1.1 Apr 14 04:20:54 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:20:54 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:20:54 user devstack@n-api.service[61597]: Connection: close Apr 14 04:20:54 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:20:54 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:20:54 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:20:54 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:20:54 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOW7OGuq-LmAu8uStQ57PQC65meARzAx6F2EZ814NyPLVuD5CYGxxrwMB8hFt5XipU04111UX9id5oRJBNz3cKH-Xyhr94eGyFupA0KUob5YTGvND0FyyiR_ArD-83XRLpOwe3k7GwKa8MGVtHWU-zbYUH5BJxO-yAqgurIsJ60XD0 Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Openstack-Nova-Api-Version: 2.49 Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Project-Id: 01cefa66350a4432ad71204b39e953be Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Project-Name: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/01cefa66350a4432ad71204b39e953be"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01cefa66350a4432ad71204b39e953be"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/01cefa66350a4432ad71204b39e953be"}]}] Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Tenant: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Tenant-Id: 01cefa66350a4432ad71204b39e953be Apr 14 04:20:54 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TaggedAttachmentsTest-926384577 Apr 14 04:20:54 user devstack@n-api.service[61597]: X-User: tempest-TaggedAttachmentsTest-926384577-project-member Apr 14 04:20:54 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:20:54 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:20:54 user devstack@n-api.service[61597]: X-User-Id: 0aeeeae7cbc340daa8cd81c1418794e0 Apr 14 04:20:54 user devstack@n-api.service[61597]: X-User-Name: tempest-TaggedAttachmentsTest-926384577-project-member Apr 14 04:20:54 user devstack@n-api.service[61597]: method: > Apr 14 04:20:54 user devstack@n-api.service[61597]: exception: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61597]: action_args: {'id': '8ed1dea8-e48a-49f7-924e-82cf639a1677'} Apr 14 04:20:54 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. Apr 14 04:20:54 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:20:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] Returning 404 to user: Instance 8ed1dea8-e48a-49f7-924e-82cf639a1677 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e013e22d-fa5e-41c7-8809-38894b54c69d tempest-TaggedAttachmentsTest-926384577 tempest-TaggedAttachmentsTest-926384577-project-member] 10.0.0.210 "GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677" status: 404 len: 111 microversion: 2.49 time: 0.065005 Apr 14 04:20:54 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 108/323] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:20:54 2023] GET /compute/v2.1/servers/8ed1dea8-e48a-49f7-924e-82cf639a1677 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 313835fa-6405-41ba-bc89-c4bfc119326a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 313835fa-6405-41ba-bc89-c4bfc119326a] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:20:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a95b504b-5425-4206-aef6-da7fd65a3a46 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a" status: 204 len: 0 microversion: 2.1 time: 0.221151 Apr 14 04:20:54 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 111/324] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:20:54 2023] DELETE /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 313835fa-6405-41ba-bc89-c4bfc119326a] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:55 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e422970cd8340bf996a135088094f51', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '280aa55745a749b7baa134334d25c9c3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-92700b60-febd-4460-8549-0eafede0c038 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a" status: 200 len: 1490 microversion: 2.1 time: 0.228040 Apr 14 04:20:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 106/325] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:54 2023] GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a => generated 1490 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-b4cc2972-b44e-4201-8d0e-6477f84a0980 req-c3f02e0d-38c2-4758-b9d1-43d5acf5efa4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b4cc2972-b44e-4201-8d0e-6477f84a0980 req-c3f02e0d-38c2-4758-b9d1-43d5acf5efa4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b4cc2972-b44e-4201-8d0e-6477f84a0980 req-c3f02e0d-38c2-4758-b9d1-43d5acf5efa4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b4cc2972-b44e-4201-8d0e-6477f84a0980 req-c3f02e0d-38c2-4758-b9d1-43d5acf5efa4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=4,nova_cell1:INSERT=2,nova_cell1:DELETE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-b4cc2972-b44e-4201-8d0e-6477f84a0980 req-c3f02e0d-38c2-4758-b9d1-43d5acf5efa4 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:20:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-b4cc2972-b44e-4201-8d0e-6477f84a0980 req-c3f02e0d-38c2-4758-b9d1-43d5acf5efa4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096997 Apr 14 04:20:56 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 109/326] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:56 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-b81ec4a6-5a82-45e7-8c46-5e422002d8c6 req-0462c0bc-7c9b-477a-83d3-34684724cc15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "313835fa-6405-41ba-bc89-c4bfc119326a", "name": "network-vif-unplugged", "status": "completed", "tag": "243334e0-8471-4569-bb6a-38c530471bb4"}, {"server_uuid": "313835fa-6405-41ba-bc89-c4bfc119326a", "name": "network-vif-plugged", "status": "completed", "tag": "243334e0-8471-4569-bb6a-38c530471bb4"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b81ec4a6-5a82-45e7-8c46-5e422002d8c6 req-0462c0bc-7c9b-477a-83d3-34684724cc15 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b81ec4a6-5a82-45e7-8c46-5e422002d8c6 req-0462c0bc-7c9b-477a-83d3-34684724cc15 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b81ec4a6-5a82-45e7-8c46-5e422002d8c6 req-0462c0bc-7c9b-477a-83d3-34684724cc15 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-b81ec4a6-5a82-45e7-8c46-5e422002d8c6 req-0462c0bc-7c9b-477a-83d3-34684724cc15 service nova] Creating event network-vif-unplugged:243334e0-8471-4569-bb6a-38c530471bb4 for instance 313835fa-6405-41ba-bc89-c4bfc119326a on user Apr 14 04:20:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-b81ec4a6-5a82-45e7-8c46-5e422002d8c6 req-0462c0bc-7c9b-477a-83d3-34684724cc15 service nova] Creating event network-vif-plugged:243334e0-8471-4569-bb6a-38c530471bb4 for instance 313835fa-6405-41ba-bc89-c4bfc119326a on user Apr 14 04:20:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-b81ec4a6-5a82-45e7-8c46-5e422002d8c6 req-0462c0bc-7c9b-477a-83d3-34684724cc15 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.056926 Apr 14 04:20:56 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 112/327] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:56 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] HTTP exception thrown: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Request method failure captured: Apr 14 04:20:56 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 HTTP/1.1 Apr 14 04:20:56 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:20:56 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:20:56 user devstack@n-api.service[61595]: Connection: close Apr 14 04:20:56 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:20:56 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:20:56 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:20:56 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:20:56 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOWSWL2iiuqjOKVXicFpVq3QynyS329JzabhIMRpTcE4u2nhOOGF_8pA3phEwF4Flx1eAEwXHOb4fAgQReFoofQtjbUxZflJc81TLe9wZ0GQOPZGEM5aHjAJmm_B5CLyBoVmu0QB2gRz5uHILI8GGX6hRONCaH8BhaaF5BW5Tr45I8 Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Project-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bae0fb4af555422a847620627dffeae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}] Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Tenant: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Tenant-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:20:56 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:20:56 user devstack@n-api.service[61595]: X-User: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:20:56 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:20:56 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:20:56 user devstack@n-api.service[61595]: X-User-Id: ea68fb139b004f748cf1bcfb8d675a2e Apr 14 04:20:56 user devstack@n-api.service[61595]: X-User-Name: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:20:56 user devstack@n-api.service[61595]: method: > Apr 14 04:20:56 user devstack@n-api.service[61595]: exception: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:20:56 user devstack@n-api.service[61595]: action_args: {'id': '59e547de-a74b-4ccd-90de-e7b61cba6964'} Apr 14 04:20:56 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:20:56 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:20:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Returning 404 to user: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:20:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-11e0932b-4754-47f4-8a56-92fc567d9ad9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964" status: 404 len: 111 microversion: 2.1 time: 0.042101 Apr 14 04:20:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 107/328] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:56 2023] GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:57 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d37cca23-ccc0-4b47-ac94-6dd5b74103ad tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 200 len: 1494 microversion: 2.1 time: 0.238706 Apr 14 04:20:57 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 110/329] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:56 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 1494 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:20:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-10d029aa-3fdf-4650-be5d-fe374c079b4a req-b3d9886a-3ff0-49d0-8270-b8050b71e873 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}, {"server_uuid": "313835fa-6405-41ba-bc89-c4bfc119326a", "name": "network-vif-deleted", "tag": "243334e0-8471-4569-bb6a-38c530471bb4"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:20:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-10d029aa-3fdf-4650-be5d-fe374c079b4a req-b3d9886a-3ff0-49d0-8270-b8050b71e873 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-10d029aa-3fdf-4650-be5d-fe374c079b4a req-b3d9886a-3ff0-49d0-8270-b8050b71e873 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-10d029aa-3fdf-4650-be5d-fe374c079b4a req-b3d9886a-3ff0-49d0-8270-b8050b71e873 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-10d029aa-3fdf-4650-be5d-fe374c079b4a req-b3d9886a-3ff0-49d0-8270-b8050b71e873 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:20:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-10d029aa-3fdf-4650-be5d-fe374c079b4a req-b3d9886a-3ff0-49d0-8270-b8050b71e873 service nova] Creating event network-vif-deleted:243334e0-8471-4569-bb6a-38c530471bb4 for instance 313835fa-6405-41ba-bc89-c4bfc119326a on user Apr 14 04:20:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-10d029aa-3fdf-4650-be5d-fe374c079b4a req-b3d9886a-3ff0-49d0-8270-b8050b71e873 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.057834 Apr 14 04:20:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 113/330] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:20:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:20:59 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:20:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-77022423-e93d-4437-b986-a1d53454df9d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1744 microversion: 2.1 time: 0.378723 Apr 14 04:20:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 108/331] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:20:59 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1744 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:04 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4f505d51-5d41-4103-b8f1-cc63b2d5beb0 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 200 len: 2822 microversion: 2.32 time: 0.289679 Apr 14 04:21:04 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 111/332] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:21:04 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 2822 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=51,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1631037722", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "7457ae38-8cd9-4172-aa34-25b764436aee"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] validate_networks() for [('7457ae38-8cd9-4172-aa34-25b764436aee', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for user 6ec7103e06e643a6b9b2c908ba8d7b06 and project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:21:15 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:21:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-8966a26b-70e1-4499-af21-5b4430319bd4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.628476 Apr 14 04:21:15 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 114/333] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 04:21:15 2023] POST /compute/v2.1/servers => generated 378 bytes in 630 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:21:15 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7d637d6a-8333-4af9-9d2a-ad7c69676ce2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:15 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7d637d6a-8333-4af9-9d2a-ad7c69676ce2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:15 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:15 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=5 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:16 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-7d637d6a-8333-4af9-9d2a-ad7c69676ce2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:16 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-7d637d6a-8333-4af9-9d2a-ad7c69676ce2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:16 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-7d637d6a-8333-4af9-9d2a-ad7c69676ce2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7d637d6a-8333-4af9-9d2a-ad7c69676ce2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074" status: 200 len: 1395 microversion: 2.87 time: 0.215474 Apr 14 04:21:16 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 109/334] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:21:15 2023] GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074 => generated 1395 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=5 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=13 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:18 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-478d77cd-a339-47cc-b122-8bc6286d1655 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1703 microversion: 2.1 time: 0.209890 Apr 14 04:21:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 112/335] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:21:17 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1703 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:21:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1b046d2c-c293-4f4f-8a7a-f3ade7728c75 req-6ef4a5f0-e010-4d3d-be23-1fd213585ede service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "226b0e81-b6a2-4094-b0f1-3fb0d3b94074", "tag": "01c99489-4391-41b0-81d9-212d7e76b28c"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1b046d2c-c293-4f4f-8a7a-f3ade7728c75 req-6ef4a5f0-e010-4d3d-be23-1fd213585ede service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1b046d2c-c293-4f4f-8a7a-f3ade7728c75 req-6ef4a5f0-e010-4d3d-be23-1fd213585ede service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1b046d2c-c293-4f4f-8a7a-f3ade7728c75 req-6ef4a5f0-e010-4d3d-be23-1fd213585ede service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1b046d2c-c293-4f4f-8a7a-f3ade7728c75 req-6ef4a5f0-e010-4d3d-be23-1fd213585ede service nova] Creating event network-changed:01c99489-4391-41b0-81d9-212d7e76b28c for instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 on user Apr 14 04:21:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1b046d2c-c293-4f4f-8a7a-f3ade7728c75 req-6ef4a5f0-e010-4d3d-be23-1fd213585ede service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034178 Apr 14 04:21:18 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 115/336] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:21:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] [instance: b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] HTTP exception thrown: Instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 could not be found. Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Request method failure captured: Apr 14 04:21:18 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 HTTP/1.1 Apr 14 04:21:18 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:21:18 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:21:18 user devstack@n-api.service[61595]: Connection: close Apr 14 04:21:18 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:21:18 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:21:18 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:21:18 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:21:18 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOhaxvHv8HPEZNZSEJWb9JS5uimWXBbvw_O4iMvcvGryjTBL4Waw6LpnJ3mJtAJLo7oCvOk8iUjwBElnp25KU3PExIcST_dIaC-ITNMR_JGvayobMiG7d2qwpf1rYFEBJuEC2nPqc1Ka1-8Yq_m30S-pZlK4iJ1LMDWXgyn8pghaP4 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Project-Id: ffadee5eeb7f4b42ae93e2e2578ef897 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestVolumeSwap-926061730 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/ffadee5eeb7f4b42ae93e2e2578ef897"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ffadee5eeb7f4b42ae93e2e2578ef897"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/ffadee5eeb7f4b42ae93e2e2578ef897"}]}] Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Tenant: tempest-TestVolumeSwap-926061730 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Tenant-Id: ffadee5eeb7f4b42ae93e2e2578ef897 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestVolumeSwap-926061730 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-User: tempest-TestVolumeSwap-926061730-project-member Apr 14 04:21:18 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:21:18 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:21:18 user devstack@n-api.service[61595]: X-User-Id: 1da030e7c9e44f9b82f3286378a2ede6 Apr 14 04:21:18 user devstack@n-api.service[61595]: X-User-Name: tempest-TestVolumeSwap-926061730-project-member Apr 14 04:21:18 user devstack@n-api.service[61595]: method: > Apr 14 04:21:18 user devstack@n-api.service[61595]: exception: Instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 could not be found. Apr 14 04:21:18 user devstack@n-api.service[61595]: action_args: {'id': 'b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7'} Apr 14 04:21:18 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 could not be found. Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 could not be found. Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 could not be found. Apr 14 04:21:18 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Returning 404 to user: Instance b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:21:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-64b917c6-fdf3-440f-b91a-4ae6831b4d0c tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7" status: 404 len: 111 microversion: 2.1 time: 0.033131 Apr 14 04:21:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 110/337] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:21:18 2023] GET /compute/v2.1/servers/b0d74dbd-d61f-4132-9e0b-ec534ec2f6a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:21:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3fc8f8dd-daf8-4693-8ce1-939333b7aa58 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] Calling method '.version_select at 0x7f538af83490>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3fc8f8dd-daf8-4693-8ce1-939333b7aa58 tempest-TestVolumeSwap-926061730 tempest-TestVolumeSwap-926061730-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360289330" status: 202 len: 0 microversion: 2.1 time: 0.023713 Apr 14 04:21:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 113/338] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:21:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1360289330 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:21:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6a5eaebf-879f-40e9-92d7-0a2f3ef4e4c4 req-b70e4619-2639-49bd-a7b8-776cdbea5aad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226b0e81-b6a2-4094-b0f1-3fb0d3b94074", "name": "network-vif-plugged", "status": "completed", "tag": "01c99489-4391-41b0-81d9-212d7e76b28c"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6a5eaebf-879f-40e9-92d7-0a2f3ef4e4c4 req-b70e4619-2639-49bd-a7b8-776cdbea5aad service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6a5eaebf-879f-40e9-92d7-0a2f3ef4e4c4 req-b70e4619-2639-49bd-a7b8-776cdbea5aad service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6a5eaebf-879f-40e9-92d7-0a2f3ef4e4c4 req-b70e4619-2639-49bd-a7b8-776cdbea5aad service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6a5eaebf-879f-40e9-92d7-0a2f3ef4e4c4 req-b70e4619-2639-49bd-a7b8-776cdbea5aad service nova] Creating event network-vif-plugged:01c99489-4391-41b0-81d9-212d7e76b28c for instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 on user Apr 14 04:21:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6a5eaebf-879f-40e9-92d7-0a2f3ef4e4c4 req-b70e4619-2639-49bd-a7b8-776cdbea5aad service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035071 Apr 14 04:21:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 116/339] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:21:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:22 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2561bbc0c6d447da333ffdbb9fdc5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d389bb78d2e40b9b07d2d3ecdb7566b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-33e2ce67-f636-441a-a98e-3e1447824336 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38" status: 200 len: 1546 microversion: 2.1 time: 0.147683 Apr 14 04:21:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 111/340] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:21:21 2023] GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38 => generated 1546 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:21:22 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-7355a16d-b013-40de-a9a5-87b5947a6bce req-2755e4a1-9697-4c45-8dad-a2d943926ecb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226b0e81-b6a2-4094-b0f1-3fb0d3b94074", "name": "network-vif-plugged", "status": "completed", "tag": "01c99489-4391-41b0-81d9-212d7e76b28c"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7355a16d-b013-40de-a9a5-87b5947a6bce req-2755e4a1-9697-4c45-8dad-a2d943926ecb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7355a16d-b013-40de-a9a5-87b5947a6bce req-2755e4a1-9697-4c45-8dad-a2d943926ecb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7355a16d-b013-40de-a9a5-87b5947a6bce req-2755e4a1-9697-4c45-8dad-a2d943926ecb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:22 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-7355a16d-b013-40de-a9a5-87b5947a6bce req-2755e4a1-9697-4c45-8dad-a2d943926ecb service nova] Creating event network-vif-plugged:01c99489-4391-41b0-81d9-212d7e76b28c for instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 on user Apr 14 04:21:22 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-7355a16d-b013-40de-a9a5-87b5947a6bce req-2755e4a1-9697-4c45-8dad-a2d943926ecb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042772 Apr 14 04:21:22 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 114/341] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:21:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:28 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lazy-loading 'flavor' on Instance uuid 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:21:29 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-0f42ce3f-8531-48c3-9db8-5f426e8733c4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc/action" status: 200 len: 32 microversion: 2.1 time: 0.175220 Apr 14 04:21:29 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 117/342] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:21:28 2023] POST /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc/action => generated 32 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:29 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-04a56c0b-dbd4-4f7a-8360-63ec7178c318 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 200 len: 1511 microversion: 2.1 time: 0.240436 Apr 14 04:21:29 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 112/343] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:21:29 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 1511 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:21:30 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-797f8a77-db6c-46c4-8321-241d5738c332 req-2a908836-03b8-4d84-b403-361ac9e64172 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-unplugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-797f8a77-db6c-46c4-8321-241d5738c332 req-2a908836-03b8-4d84-b403-361ac9e64172 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-797f8a77-db6c-46c4-8321-241d5738c332 req-2a908836-03b8-4d84-b403-361ac9e64172 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-797f8a77-db6c-46c4-8321-241d5738c332 req-2a908836-03b8-4d84-b403-361ac9e64172 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:30 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-797f8a77-db6c-46c4-8321-241d5738c332 req-2a908836-03b8-4d84-b403-361ac9e64172 service nova] Creating event network-vif-unplugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:30 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-797f8a77-db6c-46c4-8321-241d5738c332 req-2a908836-03b8-4d84-b403-361ac9e64172 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031891 Apr 14 04:21:30 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 115/344] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:21:30 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:31 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ef5d35aa-11bc-4cb5-aa95-c40987e1e77f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1721 microversion: 2.1 time: 0.350170 Apr 14 04:21:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 118/345] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:21:31 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:21:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-unplugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Creating event network-vif-unplugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-bd21ef97-8f1c-4658-a3d2-f9008f02da55 req-6cabe3a4-aea9-4e21-a2d8-f1aea01912d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.146585 Apr 14 04:21:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 113/346] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:21:32 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:21:34 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-20e284c9-bef7-45a3-ba17-f7e0bc92a2c9 req-8eed7909-3b34-4266-a61e-b938811cb541 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:21:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-20e284c9-bef7-45a3-ba17-f7e0bc92a2c9 req-8eed7909-3b34-4266-a61e-b938811cb541 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-20e284c9-bef7-45a3-ba17-f7e0bc92a2c9 req-8eed7909-3b34-4266-a61e-b938811cb541 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-20e284c9-bef7-45a3-ba17-f7e0bc92a2c9 req-8eed7909-3b34-4266-a61e-b938811cb541 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:34 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-20e284c9-bef7-45a3-ba17-f7e0bc92a2c9 req-8eed7909-3b34-4266-a61e-b938811cb541 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:34 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-20e284c9-bef7-45a3-ba17-f7e0bc92a2c9 req-8eed7909-3b34-4266-a61e-b938811cb541 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:21:34 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-20e284c9-bef7-45a3-ba17-f7e0bc92a2c9 req-8eed7909-3b34-4266-a61e-b938811cb541 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.052148 Apr 14 04:21:34 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 116/347] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:21:34 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:36 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d80d3684045298d895555247174af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bb9ddec81e4f6cbceb6ce7dee9c3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:21:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a1f11ee7-5f0e-4b00-8a0d-62ae2d138b99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 200 len: 1704 microversion: 2.1 time: 0.174160 Apr 14 04:21:36 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 119/348] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:21:36 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 1704 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=14 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=16 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] [instance: 313835fa-6405-41ba-bc89-c4bfc119326a] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:21:45 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] HTTP exception thrown: Instance 313835fa-6405-41ba-bc89-c4bfc119326a could not be found. Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Request method failure captured: Apr 14 04:21:45 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a HTTP/1.1 Apr 14 04:21:45 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:21:45 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:21:45 user devstack@n-api.service[61595]: Connection: close Apr 14 04:21:45 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:21:45 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:21:45 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:21:45 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:21:45 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONORAYPuJkgqXTmM3qXuCWxDX_YO3IfDZ2aohNz60KBH9n2wih_4npphYtpn9Y9J8rcnig_Nv-d-cMu2E5hNo7xq9Bl_RZkRNGTuhPOfXoT9KjCLTAjUaj9HQIaXUvTGtIEJaqzpq4RdO1zyXz8fdDJxF9jKwyTK2Sbg63F-rZEIxm0 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Project-Id: 280aa55745a749b7baa134334d25c9c3 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesActionsTest-447148503 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/280aa55745a749b7baa134334d25c9c3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280aa55745a749b7baa134334d25c9c3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/280aa55745a749b7baa134334d25c9c3"}]}] Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesActionsTest-447148503 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Tenant-Id: 280aa55745a749b7baa134334d25c9c3 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesActionsTest-447148503 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-User: tempest-VolumesActionsTest-447148503-project-member Apr 14 04:21:45 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:21:45 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:21:45 user devstack@n-api.service[61595]: X-User-Id: 6e422970cd8340bf996a135088094f51 Apr 14 04:21:45 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesActionsTest-447148503-project-member Apr 14 04:21:45 user devstack@n-api.service[61595]: method: > Apr 14 04:21:45 user devstack@n-api.service[61595]: exception: Instance 313835fa-6405-41ba-bc89-c4bfc119326a could not be found. Apr 14 04:21:45 user devstack@n-api.service[61595]: action_args: {'id': '313835fa-6405-41ba-bc89-c4bfc119326a'} Apr 14 04:21:45 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 313835fa-6405-41ba-bc89-c4bfc119326a could not be found. Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 313835fa-6405-41ba-bc89-c4bfc119326a could not be found. Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 313835fa-6405-41ba-bc89-c4bfc119326a could not be found. Apr 14 04:21:45 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:21:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] Returning 404 to user: Instance 313835fa-6405-41ba-bc89-c4bfc119326a could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:21:45 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7b438841-bff9-4259-985e-1e3e21ec2a10 tempest-VolumesActionsTest-447148503 tempest-VolumesActionsTest-447148503-project-member] 10.0.0.210 "GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a" status: 404 len: 111 microversion: 2.1 time: 0.199293 Apr 14 04:21:45 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 114/349] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:21:45 2023] GET /compute/v2.1/servers/313835fa-6405-41ba-bc89-c4bfc119326a => generated 111 bytes in 201 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:21:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=11,nova_api:DELETE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:21:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=12 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-705757103"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-9bd647f2-e959-478a-b6d7-b803ccc9b972 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-634025699", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a462dbfb-12e1-48c7-a797-87823269af2a"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:00 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=23,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:00 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:00 user devstack@n-api.service[61597]: INFO nova.network.security_group_api [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Removing security group 80b8092d-a2e1-43dd-8b7b-3f7f1328a80e from port ef7670a9-3421-45de-a1cd-976ddb46f2a1 Apr 14 04:22:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-9bd647f2-e959-478a-b6d7-b803ccc9b972 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] HTTP exception thrown: Block Device 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec is not bootable. Apr 14 04:22:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-9bd647f2-e959-478a-b6d7-b803ccc9b972 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Request method failure captured: Apr 14 04:22:00 user devstack@n-api.service[61596]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 04:22:00 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:22:00 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:22:00 user devstack@n-api.service[61596]: Connection: close Apr 14 04:22:00 user devstack@n-api.service[61596]: Content-Length: 356 Apr 14 04:22:00 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:22:00 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:22:00 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:22:00 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOWSWL2iiuqjOKVXicFpVq3QynyS329JzabhIMRpTcE4u2nhOOGF_8pA3phEwF4Flx1eAEwXHOb4fAgQReFoofQtjbUxZflJc81TLe9wZ0GQOPZGEM5aHjAJmm_B5CLyBoVmu0QB2gRz5uHILI8GGX6hRONCaH8BhaaF5BW5Tr45I8 Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Project-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Project-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bae0fb4af555422a847620627dffeae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}] Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Tenant: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Tenant-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:22:00 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:22:00 user devstack@n-api.service[61596]: X-User: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:22:00 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:22:00 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:22:00 user devstack@n-api.service[61596]: X-User-Id: ea68fb139b004f748cf1bcfb8d675a2e Apr 14 04:22:00 user devstack@n-api.service[61596]: X-User-Name: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:22:00 user devstack@n-api.service[61596]: Apr 14 04:22:00 user devstack@n-api.service[61596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-634025699", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "uuid": "0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec", "source_type": "volume", "destination_type": "volume", "delete_on_termination": false}], "networks": [{"uuid": "a462dbfb-12e1-48c7-a797-87823269af2a"}]}} Apr 14 04:22:00 user devstack@n-api.service[61596]: method: > Apr 14 04:22:00 user devstack@n-api.service[61596]: exception: Block Device 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec is not bootable. Apr 14 04:22:00 user devstack@n-api.service[61596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-634025699', 'imageRef': '', 'flavorRef': '42', 'block_device_mapping_v2': [{'boot_index': 0, 'source_type': 'volume', 'destination_type': 'volume', 'delete_on_termination': False, 'volume_id': '0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec'}], 'networks': [{'uuid': 'a462dbfb-12e1-48c7-a797-87823269af2a'}]}}} Apr 14 04:22:00 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 785, in create Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instances, resv_id = self.compute_api.create( Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2206, in create Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._create_instance( Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 1672, in _create_instance Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi boot_meta = block_device.get_bdm_image_metadata( Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/block_device.py", line 664, in get_bdm_image_metadata Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InvalidBDMVolumeNotBootable(id=volume_id) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidBDMVolumeNotBootable: Block Device 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec is not bootable. Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi [Previous line repeated 11 more times] Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 867, in create Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=error.format_message()) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Block Device 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec is not bootable. Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Block Device 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec is not bootable. Apr 14 04:22:00 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-9bd647f2-e959-478a-b6d7-b803ccc9b972 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Returning 400 to user: Block Device 0ce5cb1f-db77-4ff4-975b-abaf2b0e10ec is not bootable. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:22:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-9bd647f2-e959-478a-b6d7-b803ccc9b972 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 110 microversion: 2.1 time: 0.078537 Apr 14 04:22:00 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 120/350] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:22:00 2023] POST /compute/v2.1/servers => generated 110 bytes in 80 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:00 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7033b5b4-fa19-46d6-b129-5f827910a9ca tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 200 len: 1494 microversion: 2.1 time: 0.194650 Apr 14 04:22:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 115/351] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:00 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 1494 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:00 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-db6dcebf-2887-45b8-a384-1e7392c45b22 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/action" status: 202 len: 0 microversion: 2.1 time: 0.889305 Apr 14 04:22:00 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 117/352] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:21:59 2023] POST /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/action => generated 0 bytes in 892 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:22:01 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-803f2656-3789-49f3-abc8-ec2468db167a req-d1510086-96dc-43e3-93cb-0a04bdb9a82c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-803f2656-3789-49f3-abc8-ec2468db167a req-d1510086-96dc-43e3-93cb-0a04bdb9a82c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-803f2656-3789-49f3-abc8-ec2468db167a req-d1510086-96dc-43e3-93cb-0a04bdb9a82c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-803f2656-3789-49f3-abc8-ec2468db167a req-d1510086-96dc-43e3-93cb-0a04bdb9a82c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:01 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-803f2656-3789-49f3-abc8-ec2468db167a req-d1510086-96dc-43e3-93cb-0a04bdb9a82c service nova] Creating event network-changed:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:22:01 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-803f2656-3789-49f3-abc8-ec2468db167a req-d1510086-96dc-43e3-93cb-0a04bdb9a82c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266660 Apr 14 04:22:01 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 121/353] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-130152a6-0c80-4184-a796-3a21a605f027 req-d1188bd3-5f2f-43bc-b656-33d86a7b0cfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-130152a6-0c80-4184-a796-3a21a605f027 req-d1188bd3-5f2f-43bc-b656-33d86a7b0cfc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-130152a6-0c80-4184-a796-3a21a605f027 req-d1188bd3-5f2f-43bc-b656-33d86a7b0cfc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-130152a6-0c80-4184-a796-3a21a605f027 req-d1188bd3-5f2f-43bc-b656-33d86a7b0cfc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-130152a6-0c80-4184-a796-3a21a605f027 req-d1188bd3-5f2f-43bc-b656-33d86a7b0cfc service nova] Creating event network-changed:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:22:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-130152a6-0c80-4184-a796-3a21a605f027 req-d1188bd3-5f2f-43bc-b656-33d86a7b0cfc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040437 Apr 14 04:22:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 116/354] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:02 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lazy-loading 'services' on Instance uuid 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:22:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-acc239df-616b-4636-a442-daf1ab9f7363 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments/70317b0d-2515-45ac-825b-207626822497" status: 202 len: 0 microversion: 2.1 time: 0.294633 Apr 14 04:22:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 118/355] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:22:02 2023] DELETE /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments/70317b0d-2515-45ac-825b-207626822497 => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-70f702da-1038-420f-a317-c98c4d172929 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082099 Apr 14 04:22:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 122/356] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:22:02 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-40ea411b-8ba6-4b4b-a2ae-24ad66596d87 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.169170 Apr 14 04:22:05 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 117/357] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 04:22:05 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048/os-interface => generated 1828 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-8d09a653-539e-4ad5-8576-0b1c66adf6b2 req-e8f70905-ac57-43b6-8654-ebde07a95ced service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "tag": "42a38c57-4357-4a88-91e3-d76bb38534db"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8d09a653-539e-4ad5-8576-0b1c66adf6b2 req-e8f70905-ac57-43b6-8654-ebde07a95ced service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8d09a653-539e-4ad5-8576-0b1c66adf6b2 req-e8f70905-ac57-43b6-8654-ebde07a95ced service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8d09a653-539e-4ad5-8576-0b1c66adf6b2 req-e8f70905-ac57-43b6-8654-ebde07a95ced service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-8d09a653-539e-4ad5-8576-0b1c66adf6b2 req-e8f70905-ac57-43b6-8654-ebde07a95ced service nova] Creating event network-changed:42a38c57-4357-4a88-91e3-d76bb38534db for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-8d09a653-539e-4ad5-8576-0b1c66adf6b2 req-e8f70905-ac57-43b6-8654-ebde07a95ced service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054753 Apr 14 04:22:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 119/358] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:06 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-87bc5753-08bb-44ea-a7cd-79cc008eb9b2 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074" status: 200 len: 1692 microversion: 2.87 time: 0.347531 Apr 14 04:22:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 123/359] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:22:06 2023] GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074 => generated 1692 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:06 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0de18494-a34e-478a-8e41-a7017ee88243 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 200 len: 2822 microversion: 2.32 time: 0.323734 Apr 14 04:22:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 118/360] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:22:06 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 2822 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3a59fe64-4418-4683-acbc-ac175a63e03d tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048/os-interface" status: 200 len: 1828 microversion: 2.32 time: 0.194937 Apr 14 04:22:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 120/361] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 04:22:06 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048/os-interface => generated 1828 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:22:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-64d3668d-ef08-4702-ac04-8fcba8c89fa6 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 204 len: 0 microversion: 2.32 time: 0.156516 Apr 14 04:22:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 124/362] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:22:08 2023] DELETE /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:08 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '3537afcf5a3e47deb53acb34d00e0e83', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3162a049880f4b85afda331443cf52f1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f6079430-a59f-4402-af31-02a3dc8bf82a tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 200 len: 2946 microversion: 2.32 time: 0.278215 Apr 14 04:22:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 119/363] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:22:08 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 2946 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:22:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-34be42b8-72c2-4b28-8050-d203835f0b2f req-913ccc5c-029e-4872-a1bf-f50672935fe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-unplugged", "status": "completed", "tag": "42a38c57-4357-4a88-91e3-d76bb38534db"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-34be42b8-72c2-4b28-8050-d203835f0b2f req-913ccc5c-029e-4872-a1bf-f50672935fe6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-34be42b8-72c2-4b28-8050-d203835f0b2f req-913ccc5c-029e-4872-a1bf-f50672935fe6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-34be42b8-72c2-4b28-8050-d203835f0b2f req-913ccc5c-029e-4872-a1bf-f50672935fe6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-34be42b8-72c2-4b28-8050-d203835f0b2f req-913ccc5c-029e-4872-a1bf-f50672935fe6 service nova] Creating event network-vif-unplugged:42a38c57-4357-4a88-91e3-d76bb38534db for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-34be42b8-72c2-4b28-8050-d203835f0b2f req-913ccc5c-029e-4872-a1bf-f50672935fe6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.126343 Apr 14 04:22:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 121/364] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-c730e6f2-b37b-4295-aea1-d35859f9f478 req-d2668f54-053e-4de9-9463-6fde10da76fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-unplugged", "status": "completed", "tag": "186b0001-a3cf-40fa-babf-6b7045fbdb26"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c730e6f2-b37b-4295-aea1-d35859f9f478 req-d2668f54-053e-4de9-9463-6fde10da76fc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c730e6f2-b37b-4295-aea1-d35859f9f478 req-d2668f54-053e-4de9-9463-6fde10da76fc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c730e6f2-b37b-4295-aea1-d35859f9f478 req-d2668f54-053e-4de9-9463-6fde10da76fc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-c730e6f2-b37b-4295-aea1-d35859f9f478 req-d2668f54-053e-4de9-9463-6fde10da76fc service nova] Creating event network-vif-unplugged:186b0001-a3cf-40fa-babf-6b7045fbdb26 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-c730e6f2-b37b-4295-aea1-d35859f9f478 req-d2668f54-053e-4de9-9463-6fde10da76fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.056360 Apr 14 04:22:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 125/365] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "186b0001-a3cf-40fa-babf-6b7045fbdb26"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-unplugged", "status": "completed", "tag": "70e5d70d-d9af-4853-9de8-2cbff2433c60"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "70e5d70d-d9af-4853-9de8-2cbff2433c60"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-unplugged", "status": "completed", "tag": "8bfa317e-3995-442d-b5ab-cb1199cb1fb8"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Creating event network-vif-plugged:186b0001-a3cf-40fa-babf-6b7045fbdb26 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Creating event network-vif-unplugged:70e5d70d-d9af-4853-9de8-2cbff2433c60 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Creating event network-vif-plugged:70e5d70d-d9af-4853-9de8-2cbff2433c60 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] Creating event network-vif-unplugged:8bfa317e-3995-442d-b5ab-cb1199cb1fb8 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-9fac2a39-2b3a-4375-b98f-2ec671d44efc req-55a305ea-b869-4a09-b544-5a2798ffe75b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.042824 Apr 14 04:22:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 120/366] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:10 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "42a38c57-4357-4a88-91e3-d76bb38534db"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-unplugged", "status": "completed", "tag": "97ba6e98-092c-472f-9f27-eab96fe7f9ae"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "97ba6e98-092c-472f-9f27-eab96fe7f9ae"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] Creating event network-vif-plugged:42a38c57-4357-4a88-91e3-d76bb38534db for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] Creating event network-vif-unplugged:97ba6e98-092c-472f-9f27-eab96fe7f9ae for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] Creating event network-vif-plugged:97ba6e98-092c-472f-9f27-eab96fe7f9ae for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-e331d490-3e86-4ac2-b802-a738d8cb251e req-16cd748d-e1eb-43d0-8260-d2221a9aef47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.050243 Apr 14 04:22:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 122/367] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:11 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:12 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1c331273-ae67-4e0e-b411-58340282a44e req-29b5243c-025f-4aae-be69-afaa8da21aea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "8bfa317e-3995-442d-b5ab-cb1199cb1fb8"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1c331273-ae67-4e0e-b411-58340282a44e req-29b5243c-025f-4aae-be69-afaa8da21aea service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1c331273-ae67-4e0e-b411-58340282a44e req-29b5243c-025f-4aae-be69-afaa8da21aea service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1c331273-ae67-4e0e-b411-58340282a44e req-29b5243c-025f-4aae-be69-afaa8da21aea service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1c331273-ae67-4e0e-b411-58340282a44e req-29b5243c-025f-4aae-be69-afaa8da21aea service nova] Creating event network-vif-plugged:8bfa317e-3995-442d-b5ab-cb1199cb1fb8 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1c331273-ae67-4e0e-b411-58340282a44e req-29b5243c-025f-4aae-be69-afaa8da21aea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038040 Apr 14 04:22:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 126/368] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-unplugged", "status": "completed", "tag": "62770b99-cf54-4132-ad17-d1859ddf8443"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "62770b99-cf54-4132-ad17-d1859ddf8443"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-unplugged", "status": "completed", "tag": "7249969b-00f8-4c4d-8573-832c3e0eb8fe"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-plugged", "status": "completed", "tag": "7249969b-00f8-4c4d-8573-832c3e0eb8fe"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Creating event network-vif-unplugged:62770b99-cf54-4132-ad17-d1859ddf8443 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Creating event network-vif-plugged:62770b99-cf54-4132-ad17-d1859ddf8443 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Creating event network-vif-unplugged:7249969b-00f8-4c4d-8573-832c3e0eb8fe for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] Creating event network-vif-plugged:7249969b-00f8-4c4d-8573-832c3e0eb8fe for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-5df6e6d8-4df7-49a9-a775-ddfa9f96a4fe req-3430002b-f4fb-4497-875c-39f14ba43498 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 700 microversion: 2.1 time: 0.039613 Apr 14 04:22:13 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 121/369] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:13 2023] POST /compute/v2.1/os-server-external-events => generated 700 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-4da21b9a-8cfb-4512-a657-e95e476458bb req-6d774034-0c9e-4555-bd8b-31e26b0d4862 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-deleted", "tag": "62770b99-cf54-4132-ad17-d1859ddf8443"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4da21b9a-8cfb-4512-a657-e95e476458bb req-6d774034-0c9e-4555-bd8b-31e26b0d4862 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4da21b9a-8cfb-4512-a657-e95e476458bb req-6d774034-0c9e-4555-bd8b-31e26b0d4862 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4da21b9a-8cfb-4512-a657-e95e476458bb req-6d774034-0c9e-4555-bd8b-31e26b0d4862 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-4da21b9a-8cfb-4512-a657-e95e476458bb req-6d774034-0c9e-4555-bd8b-31e26b0d4862 service nova] Creating event network-vif-deleted:62770b99-cf54-4132-ad17-d1859ddf8443 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-4da21b9a-8cfb-4512-a657-e95e476458bb req-6d774034-0c9e-4555-bd8b-31e26b0d4862 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056853 Apr 14 04:22:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 123/370] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-deleted", "tag": "42a38c57-4357-4a88-91e3-d76bb38534db"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-deleted", "tag": "7249969b-00f8-4c4d-8573-832c3e0eb8fe"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-deleted", "tag": "97ba6e98-092c-472f-9f27-eab96fe7f9ae"}, {"server_uuid": "3d9cd123-3212-4a1d-b7c8-cf0441101048", "name": "network-vif-deleted", "tag": "8bfa317e-3995-442d-b5ab-cb1199cb1fb8"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Creating event network-vif-deleted:42a38c57-4357-4a88-91e3-d76bb38534db for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Creating event network-vif-deleted:7249969b-00f8-4c4d-8573-832c3e0eb8fe for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Creating event network-vif-deleted:97ba6e98-092c-472f-9f27-eab96fe7f9ae for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] Creating event network-vif-deleted:8bfa317e-3995-442d-b5ab-cb1199cb1fb8 for instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 on user Apr 14 04:22:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-0808a576-5048-476e-94cc-e2b986210609 req-1510ce6a-3472-4a3a-a03f-43f38544cfd5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.034921 Apr 14 04:22:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 127/371] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:17 2023] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:18 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lazy-loading 'services' on Instance uuid da3b4651-aaa0-430d-85b8-c15de386d08f {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:22:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-35eed0d4-ee97-4054-a296-2c72f10a8926 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-volume_attachments/b7e94002-3eeb-442d-b224-ef83dacfa5a4" status: 202 len: 0 microversion: 2.1 time: 0.286303 Apr 14 04:22:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 122/372] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:22:18 2023] DELETE /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-volume_attachments/b7e94002-3eeb-442d-b224-ef83dacfa5a4 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:19 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5075f53e-b782-4ed8-b2bd-035aec5634fa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 200 len: 1491 microversion: 2.1 time: 0.383822 Apr 14 04:22:19 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 124/373] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:19 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 1491 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7baca928-383a-478b-a594-3ee636f35a78 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7baca928-383a-478b-a594-3ee636f35a78 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7baca928-383a-478b-a594-3ee636f35a78 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7baca928-383a-478b-a594-3ee636f35a78 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:21 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-7baca928-383a-478b-a594-3ee636f35a78 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Going to try to stop instance {{(pid=61596) force_stop /opt/stack/nova/nova/compute/api.py:2764}} Apr 14 04:22:21 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7baca928-383a-478b-a594-3ee636f35a78 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action" status: 202 len: 0 microversion: 2.1 time: 0.084861 Apr 14 04:22:21 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 128/374] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:22:20 2023] POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action => generated 0 bytes in 87 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ca9ee446-8211-4dfd-89f2-f89a02cd69ef tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1667 microversion: 2.1 time: 0.411562 Apr 14 04:22:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 123/375] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:21 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1667 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-0b1472af-0947-4ba2-ab55-9e3430f0050b req-f321c424-12f0-493a-b1d1-0e03739be693 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-unplugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0b1472af-0947-4ba2-ab55-9e3430f0050b req-f321c424-12f0-493a-b1d1-0e03739be693 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0b1472af-0947-4ba2-ab55-9e3430f0050b req-f321c424-12f0-493a-b1d1-0e03739be693 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0b1472af-0947-4ba2-ab55-9e3430f0050b req-f321c424-12f0-493a-b1d1-0e03739be693 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-0b1472af-0947-4ba2-ab55-9e3430f0050b req-f321c424-12f0-493a-b1d1-0e03739be693 service nova] Creating event network-vif-unplugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:22:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-0b1472af-0947-4ba2-ab55-9e3430f0050b req-f321c424-12f0-493a-b1d1-0e03739be693 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033835 Apr 14 04:22:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 125/376] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-0406bcee-26c1-4e4b-9c45-dbe30aa446d7 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.104982 Apr 14 04:22:22 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 129/377] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:22:22 2023] GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-interface => generated 282 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:23 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0a747dd7-e004-4cef-93c6-630bff31b59b req-7ea228ed-2655-4f80-84b2-bcdc89ea557c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2e6cf32-080b-47b2-b4db-2b776ba85b38", "tag": "7c8689e1-9c0a-42b6-8cb3-7751f619ba1f"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0a747dd7-e004-4cef-93c6-630bff31b59b req-7ea228ed-2655-4f80-84b2-bcdc89ea557c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0a747dd7-e004-4cef-93c6-630bff31b59b req-7ea228ed-2655-4f80-84b2-bcdc89ea557c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0a747dd7-e004-4cef-93c6-630bff31b59b req-7ea228ed-2655-4f80-84b2-bcdc89ea557c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0a747dd7-e004-4cef-93c6-630bff31b59b req-7ea228ed-2655-4f80-84b2-bcdc89ea557c service nova] Creating event network-changed:7c8689e1-9c0a-42b6-8cb3-7751f619ba1f for instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 on user Apr 14 04:22:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0a747dd7-e004-4cef-93c6-630bff31b59b req-7ea228ed-2655-4f80-84b2-bcdc89ea557c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109277 Apr 14 04:22:23 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 124/378] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:23 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-7469f5b6-df9e-41cd-9b55-6c589b4e6f1e req-8bdeddd5-8b2d-4c23-b414-c9a45ba137de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7469f5b6-df9e-41cd-9b55-6c589b4e6f1e req-8bdeddd5-8b2d-4c23-b414-c9a45ba137de service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7469f5b6-df9e-41cd-9b55-6c589b4e6f1e req-8bdeddd5-8b2d-4c23-b414-c9a45ba137de service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7469f5b6-df9e-41cd-9b55-6c589b4e6f1e req-8bdeddd5-8b2d-4c23-b414-c9a45ba137de service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-7469f5b6-df9e-41cd-9b55-6c589b4e6f1e req-8bdeddd5-8b2d-4c23-b414-c9a45ba137de service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:22:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-7469f5b6-df9e-41cd-9b55-6c589b4e6f1e req-8bdeddd5-8b2d-4c23-b414-c9a45ba137de service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041414 Apr 14 04:22:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 126/379] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "76b8598c-a7c5-4cc7-bd79-eb7d98b3da66"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:27 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f634c40f-d9b6-4518-a7bb-0591e63dfec9 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "POST /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312894 Apr 14 04:22:27 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 130/380] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:22:26 2023] POST /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments => generated 194 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=21 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=46,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:31 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6af794cb-911f-44ec-b92e-b1ce17730b7f tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1721 microversion: 2.1 time: 0.158713 Apr 14 04:22:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 125/381] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:31 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=21 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:31 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:32 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:32 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f1ccb59b-0775-417d-afac-2f989dd0d780 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1721 microversion: 2.1 time: 0.176822 Apr 14 04:22:32 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 127/382] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:31 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-342ecc7a-d4c1-4ea1-bc76-9432521f482c tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/action" status: 202 len: 0 microversion: 2.1 time: 0.291547 Apr 14 04:22:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 131/383] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:22:37 2023] POST /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/action => generated 0 bytes in 293 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-929176901", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "21178b4b-c88e-43e2-9154-d5116a59802d"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0dc526b5-27d2-4cde-9358-b83f6257c39f tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.139378 Apr 14 04:22:37 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 126/384] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:22:37 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-interface => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:37 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] validate_networks() for [('21178b4b-c88e-43e2-9154-d5116a59802d', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:22:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-215a4420-97cf-4480-b421-55a94514adda req-ad76c381-0a2f-4240-9162-3271f806795e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-unplugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "565c4f8c-047a-4232-a20c-64f319db5a0b"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-215a4420-97cf-4480-b421-55a94514adda req-ad76c381-0a2f-4240-9162-3271f806795e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-215a4420-97cf-4480-b421-55a94514adda req-ad76c381-0a2f-4240-9162-3271f806795e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-215a4420-97cf-4480-b421-55a94514adda req-ad76c381-0a2f-4240-9162-3271f806795e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-215a4420-97cf-4480-b421-55a94514adda req-ad76c381-0a2f-4240-9162-3271f806795e service nova] Creating event network-vif-unplugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:22:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-215a4420-97cf-4480-b421-55a94514adda req-ad76c381-0a2f-4240-9162-3271f806795e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033288 Apr 14 04:22:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 127/385] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Getting quotas for project 0848c9a67e2746e5b12b73920215b729. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Getting quotas for user e4a70281d6734c15b3c4b1b00e4b5d44 and project 0848c9a67e2746e5b12b73920215b729. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:22:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] HTTP exception thrown: Volume 565c4f8c-047a-4232-a20c-64f319db5a0b could not be found. Apr 14 04:22:38 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-7e085d7f-3da9-4a0d-b9c8-8d2b384fa2fd tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 1.252729 Apr 14 04:22:38 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 128/386] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:22:37 2023] POST /compute/v2.1/servers => generated 378 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Request method failure captured: Apr 14 04:22:38 user devstack@n-api.service[61596]: request: PUT /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments/76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 HTTP/1.1 Apr 14 04:22:38 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:22:38 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:22:38 user devstack@n-api.service[61596]: Connection: close Apr 14 04:22:38 user devstack@n-api.service[61596]: Content-Length: 74 Apr 14 04:22:38 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:22:38 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:22:38 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:22:38 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONSMKJVj1zLBVLCSSU18DRsfXGqYJUblArDPO3vIGKk3rAPBLvBCwoARClO20_WuO10OAP6wbq3vanGKpNkjOWKDh6OvzMF7LalONt4P2rspxt6VyK0OyF0AqhChtGWnuDWAENTbNot2genqs30sFRHE_EEvXWpTlkQfuFPPGO9runc Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Project-Id: caeb562508c74a9aa49999eabeb79a84 Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesAdminNegativeTest-1895968812 Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Role: member,reader,admin Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Roles: member,reader,admin Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/caeb562508c74a9aa49999eabeb79a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caeb562508c74a9aa49999eabeb79a84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caeb562508c74a9aa49999eabeb79a84"}]}] Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesAdminNegativeTest-1895968812 Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Tenant-Id: caeb562508c74a9aa49999eabeb79a84 Apr 14 04:22:38 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1895968812 Apr 14 04:22:38 user devstack@n-api.service[61596]: X-User: tempest-VolumesAdminNegativeTest-1895968812-project-admin Apr 14 04:22:38 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:22:38 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:22:38 user devstack@n-api.service[61596]: X-User-Id: ff9aa4b1f196460194f37b10747b7088 Apr 14 04:22:38 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesAdminNegativeTest-1895968812-project-admin Apr 14 04:22:38 user devstack@n-api.service[61596]: Apr 14 04:22:38 user devstack@n-api.service[61596]: {"volumeAttachment": {"volumeId": "565c4f8c-047a-4232-a20c-64f319db5a0b"}} Apr 14 04:22:38 user devstack@n-api.service[61596]: method: > Apr 14 04:22:38 user devstack@n-api.service[61596]: exception: Volume 565c4f8c-047a-4232-a20c-64f319db5a0b could not be found. Apr 14 04:22:38 user devstack@n-api.service[61596]: action_args: {'server_id': 'd2e6cf32-080b-47b2-b4db-2b776ba85b38', 'id': '76b8598c-a7c5-4cc7-bd79-eb7d98b3da66', 'body': {'volumeAttachment': {'volumeId': '565c4f8c-047a-4232-a20c-64f319db5a0b'}}} Apr 14 04:22:38 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 565c4f8c-047a-4232-a20c-64f319db5a0b could not be found. (HTTP 404) (Request-ID: req-2603077f-f6e5-4c5c-aee8-dcd3385ba736) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 436, in _update_volume_swap Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi new_volume = self.volume_api.get(context, new_volume_id) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 565c4f8c-047a-4232-a20c-64f319db5a0b could not be found. Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 445, in _update_volume_swap Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Volume 565c4f8c-047a-4232-a20c-64f319db5a0b could not be found. Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 565c4f8c-047a-4232-a20c-64f319db5a0b could not be found. Apr 14 04:22:38 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:22:38 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Returning 400 to user: Volume 565c4f8c-047a-4232-a20c-64f319db5a0b could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:22:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-338f7e88-fdb2-4af3-8565-2a80d633b045 tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments/76b8598c-a7c5-4cc7-bd79-eb7d98b3da66" status: 400 len: 107 microversion: 2.1 time: 0.281892 Apr 14 04:22:38 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 132/387] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 04:22:38 2023] PUT /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments/76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 => generated 107 bytes in 284 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:22:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-93ddd9f0-37fd-49c8-9c30-6bd08a260f25 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:38 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-93ddd9f0-37fd-49c8-9c30-6bd08a260f25 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:38 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-93ddd9f0-37fd-49c8-9c30-6bd08a260f25 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a70281d6734c15b3c4b1b00e4b5d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848c9a67e2746e5b12b73920215b729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-93ddd9f0-37fd-49c8-9c30-6bd08a260f25 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f" status: 200 len: 1212 microversion: 2.1 time: 0.093067 Apr 14 04:22:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 128/388] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:38 2023] GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f => generated 1212 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:38 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lazy-loading 'services' on Instance uuid d2e6cf32-080b-47b2-b4db-2b776ba85b38 {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:22:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fe53da21-462c-4f86-9fee-2bb335f82587 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments/76b8598c-a7c5-4cc7-bd79-eb7d98b3da66" status: 202 len: 0 microversion: 2.1 time: 0.204941 Apr 14 04:22:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 129/389] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:22:38 2023] DELETE /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments/76b8598c-a7c5-4cc7-bd79-eb7d98b3da66 => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7721f637-c058-4fc4-a9ff-eb5ba2ff3ba3 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053095 Apr 14 04:22:39 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 133/390] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:22:39 2023] GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"name": "network-changed", "server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"name": "network-changed", "server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:22:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] Creating event network-changed:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:22:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] Creating event network-changed:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:22:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-53335f53-525c-4c31-8d64-a5fdf83c1e92 req-a71cb9c7-f629-487c-a460-16881658f6f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 517 microversion: 2.1 time: 0.032906 Apr 14 04:22:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 129/391] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:40 2023] POST /compute/v2.1/os-server-external-events => generated 517 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-eca3381b-b360-4cd2-8ccf-5b25ed8af697 req-eb108a2f-4620-4646-96e5-bcefcc37eeb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "97392a47-53f0-4bde-977a-e2945332fe1f", "tag": "32f6910c-738f-4bbd-bd2a-a2d1b9bc261d"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-eca3381b-b360-4cd2-8ccf-5b25ed8af697 req-eb108a2f-4620-4646-96e5-bcefcc37eeb5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-eca3381b-b360-4cd2-8ccf-5b25ed8af697 req-eb108a2f-4620-4646-96e5-bcefcc37eeb5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-eca3381b-b360-4cd2-8ccf-5b25ed8af697 req-eb108a2f-4620-4646-96e5-bcefcc37eeb5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-eca3381b-b360-4cd2-8ccf-5b25ed8af697 req-eb108a2f-4620-4646-96e5-bcefcc37eeb5 service nova] Creating event network-changed:32f6910c-738f-4bbd-bd2a-a2d1b9bc261d for instance 97392a47-53f0-4bde-977a-e2945332fe1f on user Apr 14 04:22:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-eca3381b-b360-4cd2-8ccf-5b25ed8af697 req-eb108a2f-4620-4646-96e5-bcefcc37eeb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033817 Apr 14 04:22:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 130/392] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:42 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:42 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-9673e2b5-69d3-4b19-ab42-c144e6d67ca1 req-a5e8504f-7d67-44a0-8383-814e20ff8fd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}, {"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:42 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9673e2b5-69d3-4b19-ab42-c144e6d67ca1 req-a5e8504f-7d67-44a0-8383-814e20ff8fd4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:42 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9673e2b5-69d3-4b19-ab42-c144e6d67ca1 req-a5e8504f-7d67-44a0-8383-814e20ff8fd4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:42 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9673e2b5-69d3-4b19-ab42-c144e6d67ca1 req-a5e8504f-7d67-44a0-8383-814e20ff8fd4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:42 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-9673e2b5-69d3-4b19-ab42-c144e6d67ca1 req-a5e8504f-7d67-44a0-8383-814e20ff8fd4 service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:22:42 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-9673e2b5-69d3-4b19-ab42-c144e6d67ca1 req-a5e8504f-7d67-44a0-8383-814e20ff8fd4 service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:22:42 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-9673e2b5-69d3-4b19-ab42-c144e6d67ca1 req-a5e8504f-7d67-44a0-8383-814e20ff8fd4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.032192 Apr 14 04:22:42 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 134/393] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:42 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:44 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-74fc59ad-ec76-4abe-b962-29da1ea900d9 req-c609f371-cd63-4790-8ddd-85bdc6a2e125 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97392a47-53f0-4bde-977a-e2945332fe1f", "name": "network-vif-plugged", "status": "completed", "tag": "32f6910c-738f-4bbd-bd2a-a2d1b9bc261d"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-74fc59ad-ec76-4abe-b962-29da1ea900d9 req-c609f371-cd63-4790-8ddd-85bdc6a2e125 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-74fc59ad-ec76-4abe-b962-29da1ea900d9 req-c609f371-cd63-4790-8ddd-85bdc6a2e125 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-74fc59ad-ec76-4abe-b962-29da1ea900d9 req-c609f371-cd63-4790-8ddd-85bdc6a2e125 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-74fc59ad-ec76-4abe-b962-29da1ea900d9 req-c609f371-cd63-4790-8ddd-85bdc6a2e125 service nova] Creating event network-vif-plugged:32f6910c-738f-4bbd-bd2a-a2d1b9bc261d for instance 97392a47-53f0-4bde-977a-e2945332fe1f on user Apr 14 04:22:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-74fc59ad-ec76-4abe-b962-29da1ea900d9 req-c609f371-cd63-4790-8ddd-85bdc6a2e125 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035940 Apr 14 04:22:44 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 130/394] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f324fef4-cd81-45bb-bed5-1c96a4c75c63 req-b5e799c8-7311-4aae-a5ca-d559f05a87d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97392a47-53f0-4bde-977a-e2945332fe1f", "name": "network-vif-plugged", "status": "completed", "tag": "32f6910c-738f-4bbd-bd2a-a2d1b9bc261d"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f324fef4-cd81-45bb-bed5-1c96a4c75c63 req-b5e799c8-7311-4aae-a5ca-d559f05a87d3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f324fef4-cd81-45bb-bed5-1c96a4c75c63 req-b5e799c8-7311-4aae-a5ca-d559f05a87d3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f324fef4-cd81-45bb-bed5-1c96a4c75c63 req-b5e799c8-7311-4aae-a5ca-d559f05a87d3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f324fef4-cd81-45bb-bed5-1c96a4c75c63 req-b5e799c8-7311-4aae-a5ca-d559f05a87d3 service nova] Creating event network-vif-plugged:32f6910c-738f-4bbd-bd2a-a2d1b9bc261d for instance 97392a47-53f0-4bde-977a-e2945332fe1f on user Apr 14 04:22:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f324fef4-cd81-45bb-bed5-1c96a4c75c63 req-b5e799c8-7311-4aae-a5ca-d559f05a87d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036385 Apr 14 04:22:46 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 131/395] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-513e057e-ca13-46a5-ae89-d6e2e2fb4fab tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.339245 Apr 14 04:22:52 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 135/396] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:22:52 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments => generated 25 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] HTTP exception thrown: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e is not attached to volume 70317b0d-2515-45ac-825b-207626822497 Apr 14 04:22:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Request method failure captured: Apr 14 04:22:53 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments/70317b0d-2515-45ac-825b-207626822497 HTTP/1.1 Apr 14 04:22:53 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:22:53 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:22:53 user devstack@n-api.service[61595]: Connection: close Apr 14 04:22:53 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:22:53 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:22:53 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:22:53 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:22:53 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONPmOoVtJAGLFUqi790xjd6yAgn1Mr0hQlpr-3r6seQZuXjK_zTQAX5XhYT1vIJVPL97tNWIEVIteW1KsXSLIUZqr5VBGYGSlaw6pxGVP6EIdjFYKI3Gpbot4VU-_rTtvJ5g3gi32e1KkyfmUvqgoknW0f0J5rjXRQ7OW8dqHGEU4TY Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Project-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}] Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Tenant: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Tenant-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:22:53 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:22:53 user devstack@n-api.service[61595]: X-User: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:22:53 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:22:53 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:22:53 user devstack@n-api.service[61595]: X-User-Id: 982f167333954612a51911fc8d6c1ce9 Apr 14 04:22:53 user devstack@n-api.service[61595]: X-User-Name: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:22:53 user devstack@n-api.service[61595]: method: > Apr 14 04:22:53 user devstack@n-api.service[61595]: exception: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e is not attached to volume 70317b0d-2515-45ac-825b-207626822497 Apr 14 04:22:53 user devstack@n-api.service[61595]: action_args: {'server_id': '4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e', 'id': '70317b0d-2515-45ac-825b-207626822497'} Apr 14 04:22:53 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 70317b0d-2515-45ac-825b-207626822497. Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e is not attached to volume 70317b0d-2515-45ac-825b-207626822497 Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e is not attached to volume 70317b0d-2515-45ac-825b-207626822497 Apr 14 04:22:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:22:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Returning 404 to user: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e is not attached to volume 70317b0d-2515-45ac-825b-207626822497 {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:22:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a7fb1ca8-2d43-46ad-84d9-2cda4877a2d4 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments/70317b0d-2515-45ac-825b-207626822497" status: 404 len: 154 microversion: 2.1 time: 0.122752 Apr 14 04:22:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 131/397] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:22:52 2023] DELETE /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e/os-volume_attachments/70317b0d-2515-45ac-825b-207626822497 => generated 154 bytes in 125 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1070759898", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] validate_networks() for None {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Getting quotas for project 3f45f01678f747268221c00f75924c69. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Getting quotas for user 275086d3eec449678b6b5ba6f3f887b2 and project 3f45f01678f747268221c00f75924c69. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:22:54 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] [instance: 46a5fd77-abec-4ab3-b519-7c649e63459c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:22:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-379c21e7-6515-4227-a781-e31f0bf4c638 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.523770 Apr 14 04:22:54 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 132/398] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:22:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 526 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:22:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-cf12df92-7ae2-4fea-a1b3-abe649b251e7 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-cf12df92-7ae2-4fea-a1b3-abe649b251e7 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] [instance: 46a5fd77-abec-4ab3-b519-7c649e63459c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:54 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-cf12df92-7ae2-4fea-a1b3-abe649b251e7 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275086d3eec449678b6b5ba6f3f887b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f45f01678f747268221c00f75924c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-cf12df92-7ae2-4fea-a1b3-abe649b251e7 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c" status: 200 len: 1209 microversion: 2.1 time: 0.106633 Apr 14 04:22:54 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 136/399] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:54 2023] GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c => generated 1209 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:56 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:22:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0eef3cf5-0432-497f-9b70-274ee8688e6e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 204 len: 0 microversion: 2.1 time: 0.148056 Apr 14 04:22:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 132/400] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:22:56 2023] DELETE /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:57 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:22:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-487d59cb-7c29-4108-bbd2-5cfdbe41335e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 200 len: 1539 microversion: 2.1 time: 0.242916 Apr 14 04:22:57 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 133/401] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:22:56 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 1539 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:22:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-84cb6972-b9d7-4264-9d14-db7795e754cb req-4749b97c-1236-452a-952d-f0749f5be220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-unplugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-84cb6972-b9d7-4264-9d14-db7795e754cb req-4749b97c-1236-452a-952d-f0749f5be220 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-84cb6972-b9d7-4264-9d14-db7795e754cb req-4749b97c-1236-452a-952d-f0749f5be220 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-84cb6972-b9d7-4264-9d14-db7795e754cb req-4749b97c-1236-452a-952d-f0749f5be220 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-84cb6972-b9d7-4264-9d14-db7795e754cb req-4749b97c-1236-452a-952d-f0749f5be220 service nova] Creating event network-vif-unplugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:22:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-84cb6972-b9d7-4264-9d14-db7795e754cb req-4749b97c-1236-452a-952d-f0749f5be220 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036602 Apr 14 04:22:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 137/402] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-73555978-b842-4ecd-89d0-428d03be3c99 req-889cbcdf-4727-4afa-a945-992202d98df3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46a5fd77-abec-4ab3-b519-7c649e63459c", "tag": "534d2295-4787-4bd1-9e53-4cf6acbf4a2b"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-73555978-b842-4ecd-89d0-428d03be3c99 req-889cbcdf-4727-4afa-a945-992202d98df3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-73555978-b842-4ecd-89d0-428d03be3c99 req-889cbcdf-4727-4afa-a945-992202d98df3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-73555978-b842-4ecd-89d0-428d03be3c99 req-889cbcdf-4727-4afa-a945-992202d98df3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-73555978-b842-4ecd-89d0-428d03be3c99 req-889cbcdf-4727-4afa-a945-992202d98df3 service nova] Creating event network-changed:534d2295-4787-4bd1-9e53-4cf6acbf4a2b for instance 46a5fd77-abec-4ab3-b519-7c649e63459c on user Apr 14 04:22:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-73555978-b842-4ecd-89d0-428d03be3c99 req-889cbcdf-4727-4afa-a945-992202d98df3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034491 Apr 14 04:22:58 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 133/403] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] HTTP exception thrown: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Request method failure captured: Apr 14 04:22:58 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 HTTP/1.1 Apr 14 04:22:58 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:22:58 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:22:58 user devstack@n-api.service[61597]: Connection: close Apr 14 04:22:58 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:22:58 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:22:58 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:22:58 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:22:58 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONRhg4MFlZhNPVn1a0s3J1eiwIA94EMXkdQfuXJDjIg8-qXE2Nn_G78b_yxfu3UCownh6SMDymBQC1F91VHkXWrSGjVfl7_svn2zYsDLPtmF-NpCwrqHwAIB4-RldFzVrDUWfsy7xUsSpjo15uBWm-Hg2PlBkVXRr314VIHK-AZSbh0 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Project-Id: 3162a049880f4b85afda331443cf52f1 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Project-Name: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3162a049880f4b85afda331443cf52f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3162a049880f4b85afda331443cf52f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3162a049880f4b85afda331443cf52f1"}]}] Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Tenant: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Tenant-Id: 3162a049880f4b85afda331443cf52f1 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-User: tempest-TaggedBootDevicesTest-914882220-project-member Apr 14 04:22:58 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:22:58 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:22:58 user devstack@n-api.service[61597]: X-User-Id: 3537afcf5a3e47deb53acb34d00e0e83 Apr 14 04:22:58 user devstack@n-api.service[61597]: X-User-Name: tempest-TaggedBootDevicesTest-914882220-project-member Apr 14 04:22:58 user devstack@n-api.service[61597]: method: > Apr 14 04:22:58 user devstack@n-api.service[61597]: exception: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:22:58 user devstack@n-api.service[61597]: action_args: {'id': '3d9cd123-3212-4a1d-b7c8-cf0441101048'} Apr 14 04:22:58 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:22:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:22:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Returning 404 to user: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:22:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-cbf90ee1-b90e-47b2-925f-6c9786b74fdc tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 404 len: 111 microversion: 2.32 time: 0.031599 Apr 14 04:22:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 134/404] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:22:58 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Apr 14 04:22:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3c2852fd-7f97-48dd-996e-362bb4051307 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '.version_select at 0x7f538ad7fd90>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:22:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3c2852fd-7f97-48dd-996e-362bb4051307 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-489103115" status: 204 len: 0 microversion: 2.32 time: 0.024591 Apr 14 04:22:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 138/405] 10.0.0.210 () {64 vars in 1336 bytes} [Fri Apr 14 04:22:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-489103115 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:22:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-6f417b1e-e458-4397-bc27-87a4d378ea53 req-4f57f0fa-d6c9-4f2f-9a0d-ce0291031717 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-plugged", "status": "completed", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}, {"server_uuid": "4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e", "name": "network-vif-deleted", "tag": "ef7670a9-3421-45de-a1cd-976ddb46f2a1"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:22:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-6f417b1e-e458-4397-bc27-87a4d378ea53 req-4f57f0fa-d6c9-4f2f-9a0d-ce0291031717 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:22:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-6f417b1e-e458-4397-bc27-87a4d378ea53 req-4f57f0fa-d6c9-4f2f-9a0d-ce0291031717 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:22:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-6f417b1e-e458-4397-bc27-87a4d378ea53 req-4f57f0fa-d6c9-4f2f-9a0d-ce0291031717 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:22:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-6f417b1e-e458-4397-bc27-87a4d378ea53 req-4f57f0fa-d6c9-4f2f-9a0d-ce0291031717 service nova] Creating event network-vif-plugged:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:22:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-6f417b1e-e458-4397-bc27-87a4d378ea53 req-4f57f0fa-d6c9-4f2f-9a0d-ce0291031717 service nova] Creating event network-vif-deleted:ef7670a9-3421-45de-a1cd-976ddb46f2a1 for instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e on user Apr 14 04:22:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-6f417b1e-e458-4397-bc27-87a4d378ea53 req-4f57f0fa-d6c9-4f2f-9a0d-ce0291031717 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033363 Apr 14 04:22:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 134/406] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:22:59 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:00 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:00 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-90227088-bd57-45a4-8f02-0861b9ff6c23 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 200 len: 1494 microversion: 2.1 time: 0.181273 Apr 14 04:23:00 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 135/407] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:00 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 1494 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-2e3e81ad-17d2-41e8-8081-7c1753ec074c req-400314f4-d6d1-47a1-bd13-59669743c37b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a5fd77-abec-4ab3-b519-7c649e63459c", "name": "network-vif-plugged", "status": "completed", "tag": "534d2295-4787-4bd1-9e53-4cf6acbf4a2b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2e3e81ad-17d2-41e8-8081-7c1753ec074c req-400314f4-d6d1-47a1-bd13-59669743c37b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2e3e81ad-17d2-41e8-8081-7c1753ec074c req-400314f4-d6d1-47a1-bd13-59669743c37b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2e3e81ad-17d2-41e8-8081-7c1753ec074c req-400314f4-d6d1-47a1-bd13-59669743c37b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2e3e81ad-17d2-41e8-8081-7c1753ec074c req-400314f4-d6d1-47a1-bd13-59669743c37b service nova] Creating event network-vif-plugged:534d2295-4787-4bd1-9e53-4cf6acbf4a2b for instance 46a5fd77-abec-4ab3-b519-7c649e63459c on user Apr 14 04:23:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-2e3e81ad-17d2-41e8-8081-7c1753ec074c req-400314f4-d6d1-47a1-bd13-59669743c37b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031979 Apr 14 04:23:00 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 139/408] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=41,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] HTTP exception thrown: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Request method failure captured: Apr 14 04:23:02 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 HTTP/1.1 Apr 14 04:23:02 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:23:02 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:23:02 user devstack@n-api.service[61595]: Connection: close Apr 14 04:23:02 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:23:02 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:23:02 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:23:02 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:23:02 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONRhg4MFlZhNPVn1a0s3J1eiwIA94EMXkdQfuXJDjIg8-qXE2Nn_G78b_yxfu3UCownh6SMDymBQC1F91VHkXWrSGjVfl7_svn2zYsDLPtmF-NpCwrqHwAIB4-RldFzVrDUWfsy7xUsSpjo15uBWm-Hg2PlBkVXRr314VIHK-AZSbh0 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Project-Id: 3162a049880f4b85afda331443cf52f1 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Project-Name: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3162a049880f4b85afda331443cf52f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3162a049880f4b85afda331443cf52f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3162a049880f4b85afda331443cf52f1"}]}] Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Tenant: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Tenant-Id: 3162a049880f4b85afda331443cf52f1 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-User: tempest-TaggedBootDevicesTest-914882220-project-member Apr 14 04:23:02 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:23:02 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:23:02 user devstack@n-api.service[61595]: X-User-Id: 3537afcf5a3e47deb53acb34d00e0e83 Apr 14 04:23:02 user devstack@n-api.service[61595]: X-User-Name: tempest-TaggedBootDevicesTest-914882220-project-member Apr 14 04:23:02 user devstack@n-api.service[61595]: method: > Apr 14 04:23:02 user devstack@n-api.service[61595]: exception: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61595]: action_args: {'id': '3d9cd123-3212-4a1d-b7c8-cf0441101048'} Apr 14 04:23:02 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Returning 404 to user: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:23:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7e19611d-230e-4c77-99f3-0405624ee326 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 404 len: 111 microversion: 2.32 time: 0.043147 Apr 14 04:23:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 135/409] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:23:02 2023] DELETE /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] [instance: 3d9cd123-3212-4a1d-b7c8-cf0441101048] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=37,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] HTTP exception thrown: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Request method failure captured: Apr 14 04:23:02 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 HTTP/1.1 Apr 14 04:23:02 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:23:02 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:23:02 user devstack@n-api.service[61597]: Connection: close Apr 14 04:23:02 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:23:02 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:23:02 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:23:02 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:23:02 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONRhg4MFlZhNPVn1a0s3J1eiwIA94EMXkdQfuXJDjIg8-qXE2Nn_G78b_yxfu3UCownh6SMDymBQC1F91VHkXWrSGjVfl7_svn2zYsDLPtmF-NpCwrqHwAIB4-RldFzVrDUWfsy7xUsSpjo15uBWm-Hg2PlBkVXRr314VIHK-AZSbh0 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Openstack-Nova-Api-Version: 2.32 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Project-Id: 3162a049880f4b85afda331443cf52f1 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Project-Name: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3162a049880f4b85afda331443cf52f1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3162a049880f4b85afda331443cf52f1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3162a049880f4b85afda331443cf52f1"}]}] Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Tenant: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Tenant-Id: 3162a049880f4b85afda331443cf52f1 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TaggedBootDevicesTest-914882220 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-User: tempest-TaggedBootDevicesTest-914882220-project-member Apr 14 04:23:02 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:23:02 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:23:02 user devstack@n-api.service[61597]: X-User-Id: 3537afcf5a3e47deb53acb34d00e0e83 Apr 14 04:23:02 user devstack@n-api.service[61597]: X-User-Name: tempest-TaggedBootDevicesTest-914882220-project-member Apr 14 04:23:02 user devstack@n-api.service[61597]: method: > Apr 14 04:23:02 user devstack@n-api.service[61597]: exception: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61597]: action_args: {'id': '3d9cd123-3212-4a1d-b7c8-cf0441101048'} Apr 14 04:23:02 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. Apr 14 04:23:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:23:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] Returning 404 to user: Instance 3d9cd123-3212-4a1d-b7c8-cf0441101048 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:23:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d867248e-4fe1-4710-a096-922f1b778090 tempest-TaggedBootDevicesTest-914882220 tempest-TaggedBootDevicesTest-914882220-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048" status: 404 len: 111 microversion: 2.32 time: 0.039649 Apr 14 04:23:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 136/410] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:23:02 2023] GET /compute/v2.1/servers/3d9cd123-3212-4a1d-b7c8-cf0441101048 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:23:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1a431e6c-538f-44c2-bb52-2e5d07cd6203 req-54691ba7-e93c-4fe5-b471-e84e8deebe78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a5fd77-abec-4ab3-b519-7c649e63459c", "name": "network-vif-plugged", "status": "completed", "tag": "534d2295-4787-4bd1-9e53-4cf6acbf4a2b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1a431e6c-538f-44c2-bb52-2e5d07cd6203 req-54691ba7-e93c-4fe5-b471-e84e8deebe78 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1a431e6c-538f-44c2-bb52-2e5d07cd6203 req-54691ba7-e93c-4fe5-b471-e84e8deebe78 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1a431e6c-538f-44c2-bb52-2e5d07cd6203 req-54691ba7-e93c-4fe5-b471-e84e8deebe78 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1a431e6c-538f-44c2-bb52-2e5d07cd6203 req-54691ba7-e93c-4fe5-b471-e84e8deebe78 service nova] Creating event network-vif-plugged:534d2295-4787-4bd1-9e53-4cf6acbf4a2b for instance 46a5fd77-abec-4ab3-b519-7c649e63459c on user Apr 14 04:23:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1a431e6c-538f-44c2-bb52-2e5d07cd6203 req-54691ba7-e93c-4fe5-b471-e84e8deebe78 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036852 Apr 14 04:23:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 140/411] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-22332138"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6c6ab995-9459-491b-8dbb-e3fb0e73d68a tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074/action" status: 202 len: 52 microversion: 2.87 time: 0.920400 Apr 14 04:23:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 136/412] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:23:06 2023] POST /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074/action => generated 52 bytes in 922 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:11 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lazy-loading 'services' on Instance uuid cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fce9499b-e331-4ce2-a88d-832c24a656d5 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments/3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5" status: 202 len: 0 microversion: 2.1 time: 0.206976 Apr 14 04:23:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 137/413] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:23:11 2023] DELETE /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments/3c65cdc6-8973-4e7f-a2e0-6d8ff88aa7f5 => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-8f571ce7-986d-4d0b-8a9a-fbf5d2121bff tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058795 Apr 14 04:23:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 137/414] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:23:11 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:23:11 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:11 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5c161d24-4cbe-43de-93cc-ee3b2f914992 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1644 microversion: 2.1 time: 0.190391 Apr 14 04:23:11 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 141/415] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:11 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1644 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:14 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:14 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:14 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-dfb5297c-3e3c-4ee3-baf0-57fcc9178c95 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074" status: 200 len: 1692 microversion: 2.87 time: 0.275639 Apr 14 04:23:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 138/416] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:23:13 2023] GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074 => generated 1692 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e56b46c4-52ea-450b-8863-68ccb4ade295"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:19 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] HTTP exception thrown: Cannot 'attach_volume' instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc while it is in vm_state rescued Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Request method failure captured: Apr 14 04:23:19 user devstack@n-api.service[61595]: request: POST /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc/os-volume_attachments HTTP/1.1 Apr 14 04:23:19 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:23:19 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:23:19 user devstack@n-api.service[61595]: Connection: close Apr 14 04:23:19 user devstack@n-api.service[61595]: Content-Length: 74 Apr 14 04:23:19 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:23:19 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:23:19 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:23:19 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOmH01Hutb9YRw7uP2OlEp2aln8h5oMlw6e03I64C0rdRlcywArRqsgHVh8sCAN_UYylqj-A4cprpWb6TM90dGEKDnyOXHJIuIWR9Q1QhB-vCRVDiHxb9uvmuCKQGukmWIvHvqEv-t6izPrze6I7q7h7D4ZERz8pfCORUpGc7P915g Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Project-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}] Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Tenant-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:23:19 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:23:19 user devstack@n-api.service[61595]: X-User: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:23:19 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:23:19 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:23:19 user devstack@n-api.service[61595]: X-User-Id: 5234914aec8e443b8a38ac6b38729031 Apr 14 04:23:19 user devstack@n-api.service[61595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:23:19 user devstack@n-api.service[61595]: Apr 14 04:23:19 user devstack@n-api.service[61595]: {"volumeAttachment": {"volumeId": "e56b46c4-52ea-450b-8863-68ccb4ade295"}} Apr 14 04:23:19 user devstack@n-api.service[61595]: method: > Apr 14 04:23:19 user devstack@n-api.service[61595]: exception: Cannot 'attach_volume' instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc while it is in vm_state rescued Apr 14 04:23:19 user devstack@n-api.service[61595]: action_args: {'server_id': '586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc', 'body': {'volumeAttachment': {'volumeId': 'e56b46c4-52ea-450b-8863-68ccb4ade295'}}} Apr 14 04:23:19 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc in vm_state rescued. Cannot attach_volume while the instance is in this state. Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc while it is in vm_state rescued Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc while it is in vm_state rescued Apr 14 04:23:19 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:23:19 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Returning 409 to user: Cannot 'attach_volume' instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc while it is in vm_state rescued {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:23:19 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f1687ce0-3fde-43fc-b294-686c9ad3f526 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040765 Apr 14 04:23:19 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 138/417] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:23:19 2023] POST /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-53c3e6fb-5c8b-49b6-8dfc-88ac03e519e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc/action" status: 202 len: 0 microversion: 2.1 time: 0.084704 Apr 14 04:23:19 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 142/418] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:23:19 2023] POST /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:20 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:20 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-8b15059c-57c7-4e9a-a9c0-9afd1424dff6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 200 len: 1499 microversion: 2.1 time: 0.225587 Apr 14 04:23:20 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 139/419] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:19 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 1499 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:20 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-67d22136-30ea-4b70-91ca-460be89da18b req-f6389650-fe58-417f-94a6-f612d54b2a9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-unplugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-67d22136-30ea-4b70-91ca-460be89da18b req-f6389650-fe58-417f-94a6-f612d54b2a9d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-67d22136-30ea-4b70-91ca-460be89da18b req-f6389650-fe58-417f-94a6-f612d54b2a9d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-67d22136-30ea-4b70-91ca-460be89da18b req-f6389650-fe58-417f-94a6-f612d54b2a9d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:20 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-67d22136-30ea-4b70-91ca-460be89da18b req-f6389650-fe58-417f-94a6-f612d54b2a9d service nova] Creating event network-vif-unplugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:23:20 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-67d22136-30ea-4b70-91ca-460be89da18b req-f6389650-fe58-417f-94a6-f612d54b2a9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031424 Apr 14 04:23:20 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 139/420] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-c2c56ebb-58f4-48c0-8b8d-23dd813de4fc req-1f10568d-b494-4fe3-a772-651b29b7f460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:22 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=20,nova_api:DELETE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c2c56ebb-58f4-48c0-8b8d-23dd813de4fc req-1f10568d-b494-4fe3-a772-651b29b7f460 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c2c56ebb-58f4-48c0-8b8d-23dd813de4fc req-1f10568d-b494-4fe3-a772-651b29b7f460 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c2c56ebb-58f4-48c0-8b8d-23dd813de4fc req-1f10568d-b494-4fe3-a772-651b29b7f460 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:22 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-c2c56ebb-58f4-48c0-8b8d-23dd813de4fc req-1f10568d-b494-4fe3-a772-651b29b7f460 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:23:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-c2c56ebb-58f4-48c0-8b8d-23dd813de4fc req-1f10568d-b494-4fe3-a772-651b29b7f460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042649 Apr 14 04:23:22 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 143/421] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:24 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-47b7391b-d171-407d-a011-60b46481a61d req-f7da9e5f-7d0a-4af4-aee4-419a96de3649 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-47b7391b-d171-407d-a011-60b46481a61d req-f7da9e5f-7d0a-4af4-aee4-419a96de3649 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-47b7391b-d171-407d-a011-60b46481a61d req-f7da9e5f-7d0a-4af4-aee4-419a96de3649 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-47b7391b-d171-407d-a011-60b46481a61d req-f7da9e5f-7d0a-4af4-aee4-419a96de3649 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-47b7391b-d171-407d-a011-60b46481a61d req-f7da9e5f-7d0a-4af4-aee4-419a96de3649 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:23:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-47b7391b-d171-407d-a011-60b46481a61d req-f7da9e5f-7d0a-4af4-aee4-419a96de3649 service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:23:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-47b7391b-d171-407d-a011-60b46481a61d req-f7da9e5f-7d0a-4af4-aee4-419a96de3649 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036167 Apr 14 04:23:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 140/422] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:24 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:29 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a70281d6734c15b3c4b1b00e4b5d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848c9a67e2746e5b12b73920215b729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6563f284-0ef0-4441-a9e4-cfe68f289ad5 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f" status: 200 len: 1496 microversion: 2.1 time: 0.156575 Apr 14 04:23:29 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 140/423] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:28 2023] GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:29 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e06cac9d-bc81-44b8-b590-0ead15dd32c8 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.066331 Apr 14 04:23:29 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 144/424] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:23:29 2023] GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38/os-volume_attachments => generated 25 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Apr 14 04:23:29 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesAdminNegativeTest-server-1021322658", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "617ed49c-d627-4bde-8573-e645f06f34b2"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:29 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] validate_networks() for [('617ed49c-d627-4bde-8573-e645f06f34b2', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Getting quotas for project 3d389bb78d2e40b9b07d2d3ecdb7566b. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Getting quotas for user d2561bbc0c6d447da333ffdbb9fdc5f4 and project 3d389bb78d2e40b9b07d2d3ecdb7566b. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:23:30 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:23:30 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-af3fa9ed-0e61-4d00-bfea-7a6a4f84380f tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.913811 Apr 14 04:23:30 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 141/425] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:23:29 2023] POST /compute/v2.1/servers => generated 378 bytes in 915 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:23:30 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a2e1d0f5-85bd-4590-91fe-e8e6baa52baa tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:30 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-a2e1d0f5-85bd-4590-91fe-e8e6baa52baa tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:30 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-a2e1d0f5-85bd-4590-91fe-e8e6baa52baa tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2561bbc0c6d447da333ffdbb9fdc5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d389bb78d2e40b9b07d2d3ecdb7566b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:30 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a2e1d0f5-85bd-4590-91fe-e8e6baa52baa tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55" status: 200 len: 1212 microversion: 2.1 time: 0.084064 Apr 14 04:23:30 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 141/426] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:30 2023] GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 => generated 1212 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:32 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lazy-loading 'services' on Instance uuid a0a20aeb-ed06-4c65-b87d-74f8f825457d {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:23:32 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-9c6ca001-9179-4ec1-86a8-84541ed41c44 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments/3e0082ad-1ad0-4980-a066-6017f65fce9e" status: 202 len: 0 microversion: 2.1 time: 0.323672 Apr 14 04:23:32 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 145/427] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:23:32 2023] DELETE /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments/3e0082ad-1ad0-4980-a066-6017f65fce9e => generated 0 bytes in 325 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:32 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-743bebfe-c556-4ab9-9d0d-2a9fe91a755e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053791 Apr 14 04:23:32 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 142/428] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:23:32 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:34 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-3dfde0ff-8b7a-4ffd-a067-30ab801a05b4 req-c5929d07-0c3d-435f-b25c-608565bac72f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ffb8a8e-b24f-46e8-84c4-130e9f18cf55", "tag": "d2a30aa1-7a43-4150-97c4-f312dea34ae7"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:34 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=16 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3dfde0ff-8b7a-4ffd-a067-30ab801a05b4 req-c5929d07-0c3d-435f-b25c-608565bac72f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3dfde0ff-8b7a-4ffd-a067-30ab801a05b4 req-c5929d07-0c3d-435f-b25c-608565bac72f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3dfde0ff-8b7a-4ffd-a067-30ab801a05b4 req-c5929d07-0c3d-435f-b25c-608565bac72f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:34 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-3dfde0ff-8b7a-4ffd-a067-30ab801a05b4 req-c5929d07-0c3d-435f-b25c-608565bac72f service nova] Creating event network-changed:d2a30aa1-7a43-4150-97c4-f312dea34ae7 for instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 on user Apr 14 04:23:34 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-3dfde0ff-8b7a-4ffd-a067-30ab801a05b4 req-c5929d07-0c3d-435f-b25c-608565bac72f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046284 Apr 14 04:23:34 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 142/429] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:34 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:37 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1136504d-f554-41a3-8719-dd58fa9b170f req-f4c83fe4-3cc3-400c-b95c-58afb93cdd95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffb8a8e-b24f-46e8-84c4-130e9f18cf55", "name": "network-vif-plugged", "status": "completed", "tag": "d2a30aa1-7a43-4150-97c4-f312dea34ae7"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1136504d-f554-41a3-8719-dd58fa9b170f req-f4c83fe4-3cc3-400c-b95c-58afb93cdd95 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1136504d-f554-41a3-8719-dd58fa9b170f req-f4c83fe4-3cc3-400c-b95c-58afb93cdd95 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1136504d-f554-41a3-8719-dd58fa9b170f req-f4c83fe4-3cc3-400c-b95c-58afb93cdd95 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1136504d-f554-41a3-8719-dd58fa9b170f req-f4c83fe4-3cc3-400c-b95c-58afb93cdd95 service nova] Creating event network-vif-plugged:d2a30aa1-7a43-4150-97c4-f312dea34ae7 for instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 on user Apr 14 04:23:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1136504d-f554-41a3-8719-dd58fa9b170f req-f4c83fe4-3cc3-400c-b95c-58afb93cdd95 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037436 Apr 14 04:23:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 146/430] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-178ebc30-119a-46c6-aece-28df7f68d437 req-f9b26940-9ffa-427e-b45b-c253b99fe61b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffb8a8e-b24f-46e8-84c4-130e9f18cf55", "name": "network-vif-plugged", "status": "completed", "tag": "d2a30aa1-7a43-4150-97c4-f312dea34ae7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-178ebc30-119a-46c6-aece-28df7f68d437 req-f9b26940-9ffa-427e-b45b-c253b99fe61b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-178ebc30-119a-46c6-aece-28df7f68d437 req-f9b26940-9ffa-427e-b45b-c253b99fe61b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-178ebc30-119a-46c6-aece-28df7f68d437 req-f9b26940-9ffa-427e-b45b-c253b99fe61b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-178ebc30-119a-46c6-aece-28df7f68d437 req-f9b26940-9ffa-427e-b45b-c253b99fe61b service nova] Creating event network-vif-plugged:d2a30aa1-7a43-4150-97c4-f312dea34ae7 for instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 on user Apr 14 04:23:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-178ebc30-119a-46c6-aece-28df7f68d437 req-f9b26940-9ffa-427e-b45b-c253b99fe61b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033396 Apr 14 04:23:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 143/431] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:41 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:41 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3d61f3c7-c817-4144-b3ac-9e3c9df5789d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Action: 'create', calling method: .version_select at 0x7f538aff7520>, body: {"keypair": {"name": "tempest-SnapshotDataIntegrityTests-881844326", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOjIW2Ycb+mq2tNzF5oSfsdR8libq7W1H6v9ImKoXEDVO168nnN9ZHy7JgCycEV+p/J22r0BDP5EimQKsNhepd1EFrAa2ljn1iDdZ9Zn90UYL0Ok/xoK1pzqla/0GV9JdQ=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:41 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-3d61f3c7-c817-4144-b3ac-9e3c9df5789d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Getting quotas for project 39731dbb51484eff890a74b07241ba75. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:23:41 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-3d61f3c7-c817-4144-b3ac-9e3c9df5789d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Getting quotas for user 0d3c1b814ec240279646878fd090f5f2 and project 39731dbb51484eff890a74b07241ba75. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:23:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3d61f3c7-c817-4144-b3ac-9e3c9df5789d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 404 microversion: 2.1 time: 0.270485 Apr 14 04:23:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 143/432] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:23:41 2023] POST /compute/v2.1/os-keypairs => generated 404 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-SnapshotDataIntegrityTests-server-141729612", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "key_name": "tempest-SnapshotDataIntegrityTests-881844326", "security_groups": [{"name": "tempest-secgroup-smoke-1438247087"}], "networks": [{"uuid": "694b7c0a-cb94-4b83-99aa-03c94c049086"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] validate_networks() for [('694b7c0a-cb94-4b83-99aa-03c94c049086', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:44 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Getting quotas for project 39731dbb51484eff890a74b07241ba75. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:23:44 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Getting quotas for user 0d3c1b814ec240279646878fd090f5f2 and project 39731dbb51484eff890a74b07241ba75. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:23:44 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:23:44 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:23:44 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a700cdcf-0e40-460b-bd7d-3166757cc86f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.742167 Apr 14 04:23:44 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 147/433] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:23:43 2023] POST /compute/v2.1/servers => generated 404 bytes in 744 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:23:44 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:44 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:44 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-c4e4e787-5f2d-404c-99c9-875495153089 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:44 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c4e4e787-5f2d-404c-99c9-875495153089 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:44 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-c4e4e787-5f2d-404c-99c9-875495153089 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3c1b814ec240279646878fd090f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39731dbb51484eff890a74b07241ba75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:44 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-c4e4e787-5f2d-404c-99c9-875495153089 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066" status: 200 len: 1255 microversion: 2.1 time: 0.074705 Apr 14 04:23:44 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 144/434] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:44 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066 => generated 1255 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] [instance: 46a5fd77-abec-4ab3-b519-7c649e63459c] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:45 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275086d3eec449678b6b5ba6f3f887b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f45f01678f747268221c00f75924c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:45 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-9592fa32-7f43-47c9-977a-4a3f5c43b6a3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c" status: 200 len: 1454 microversion: 2.1 time: 0.186346 Apr 14 04:23:45 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 144/435] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:44 2023] GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c => generated 1454 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] HTTP exception thrown: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e could not be found. Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Request method failure captured: Apr 14 04:23:47 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e HTTP/1.1 Apr 14 04:23:47 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:23:47 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:23:47 user devstack@n-api.service[61596]: Connection: close Apr 14 04:23:47 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:23:47 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:23:47 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:23:47 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:23:47 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONPmOoVtJAGLFUqi790xjd6yAgn1Mr0hQlpr-3r6seQZuXjK_zTQAX5XhYT1vIJVPL97tNWIEVIteW1KsXSLIUZqr5VBGYGSlaw6pxGVP6EIdjFYKI3Gpbot4VU-_rTtvJ5g3gi32e1KkyfmUvqgoknW0f0J5rjXRQ7OW8dqHGEU4TY Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Project-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}] Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Tenant: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Tenant-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:23:47 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:23:47 user devstack@n-api.service[61596]: X-User: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:23:47 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:23:47 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:23:47 user devstack@n-api.service[61596]: X-User-Id: 982f167333954612a51911fc8d6c1ce9 Apr 14 04:23:47 user devstack@n-api.service[61596]: X-User-Name: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:23:47 user devstack@n-api.service[61596]: method: > Apr 14 04:23:47 user devstack@n-api.service[61596]: exception: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e could not be found. Apr 14 04:23:47 user devstack@n-api.service[61596]: action_args: {'id': '4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e'} Apr 14 04:23:47 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e could not be found. Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e could not be found. Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e could not be found. Apr 14 04:23:47 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:23:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Returning 404 to user: Instance 4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:23:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-50ffbc3d-3814-43be-acea-69e2096df4a3 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e" status: 404 len: 111 microversion: 2.1 time: 0.039444 Apr 14 04:23:47 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 148/436] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:47 2023] GET /compute/v2.1/servers/4d5e8a8f-7f0d-453e-90a8-ee18ed034f1e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:23:47 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a5ad40e1-c7c2-4aa2-a861-86e550904512 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '.version_select at 0x7f538af82290>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a5ad40e1-c7c2-4aa2-a861-86e550904512 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1599913910" status: 202 len: 0 microversion: 2.1 time: 0.023485 Apr 14 04:23:47 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 145/437] 10.0.0.210 () {62 vars in 1349 bytes} [Fri Apr 14 04:23:47 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1599913910 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:23:47 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-fe5496f1-1ec3-4c35-99f7-e905cf65197b req-2737f551-64a6-4e20-b6e7-21a3151f5102 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-fe5496f1-1ec3-4c35-99f7-e905cf65197b req-2737f551-64a6-4e20-b6e7-21a3151f5102 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-fe5496f1-1ec3-4c35-99f7-e905cf65197b req-2737f551-64a6-4e20-b6e7-21a3151f5102 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-fe5496f1-1ec3-4c35-99f7-e905cf65197b req-2737f551-64a6-4e20-b6e7-21a3151f5102 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:47 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-fe5496f1-1ec3-4c35-99f7-e905cf65197b req-2737f551-64a6-4e20-b6e7-21a3151f5102 service nova] Creating event network-changed:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:23:47 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-fe5496f1-1ec3-4c35-99f7-e905cf65197b req-2737f551-64a6-4e20-b6e7-21a3151f5102 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038245 Apr 14 04:23:47 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 145/438] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:49 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-a5618da3-0b00-4aa4-acde-22f8ce83a326 req-5b01a2e4-5fe9-4fc4-8692-cde89bcfc159 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "name": "network-vif-plugged", "status": "completed", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a5618da3-0b00-4aa4-acde-22f8ce83a326 req-5b01a2e4-5fe9-4fc4-8692-cde89bcfc159 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a5618da3-0b00-4aa4-acde-22f8ce83a326 req-5b01a2e4-5fe9-4fc4-8692-cde89bcfc159 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a5618da3-0b00-4aa4-acde-22f8ce83a326 req-5b01a2e4-5fe9-4fc4-8692-cde89bcfc159 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:49 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-a5618da3-0b00-4aa4-acde-22f8ce83a326 req-5b01a2e4-5fe9-4fc4-8692-cde89bcfc159 service nova] Creating event network-vif-plugged:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:23:49 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-a5618da3-0b00-4aa4-acde-22f8ce83a326 req-5b01a2e4-5fe9-4fc4-8692-cde89bcfc159 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039812 Apr 14 04:23:49 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 149/439] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:49 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0dd7b20b-bb48-403c-a010-720ff5edc7bb tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'create', calling method: .version_select at 0x7f538aed4940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-231821443", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyXBaFsreuBQDAM6pDqgr0rCR6Xh6YpqhuY/rJBXhVu6O6Jb6D2jMCp0EWMBknFKHHS7zo9OjEuZQRy7TrI+gfDrzjImHlLab3mcGep976OxV4nuHSlwuq9G12jktVdmA=="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:49 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-0dd7b20b-bb48-403c-a010-720ff5edc7bb tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for project 0a60f60717b44f4ba904a949eabfe608. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:23:49 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-0dd7b20b-bb48-403c-a010-720ff5edc7bb tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for user 982f167333954612a51911fc8d6c1ce9 and project 0a60f60717b44f4ba904a949eabfe608. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:23:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0dd7b20b-bb48-403c-a010-720ff5edc7bb tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.046489 Apr 14 04:23:49 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 146/440] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:23:49 2023] POST /compute/v2.1/os-keypairs => generated 402 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:49 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-593822043", "imageRef": "0b860afe-1945-4661-a55b-1a6ae0f644ea", "flavorRef": "42", "key_name": "tempest-TestMinimumBasicScenario-231821443", "networks": [{"uuid": "d3a59e6b-aaf6-4acb-a1cb-29f980dfa5a8"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] validate_networks() for [('d3a59e6b-aaf6-4acb-a1cb-29f980dfa5a8', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for project 0a60f60717b44f4ba904a949eabfe608. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Getting quotas for user 982f167333954612a51911fc8d6c1ce9 and project 0a60f60717b44f4ba904a949eabfe608. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:23:50 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='0b860afe-1945-4661-a55b-1a6ae0f644ea',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:23:50 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-c8b5d40f-9dcd-4c55-b76b-3028eaf6907e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.865630 Apr 14 04:23:50 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 146/441] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:23:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:23:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-044a8375-c04a-44c6-ab74-185a8251f42d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:23:50 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-044a8375-c04a-44c6-ab74-185a8251f42d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:23:50 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-044a8375-c04a-44c6-ab74-185a8251f42d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:23:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-044a8375-c04a-44c6-ab74-185a8251f42d tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1251 microversion: 2.1 time: 0.124794 Apr 14 04:23:50 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 150/442] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:23:50 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1251 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:23:51 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-5387dbe8-b9e7-4e0c-b7be-a8e789c6e715 req-70875a6b-daaa-4f72-9385-73770e2b842d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "name": "network-vif-plugged", "status": "completed", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:51 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5387dbe8-b9e7-4e0c-b7be-a8e789c6e715 req-70875a6b-daaa-4f72-9385-73770e2b842d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:51 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5387dbe8-b9e7-4e0c-b7be-a8e789c6e715 req-70875a6b-daaa-4f72-9385-73770e2b842d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:51 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5387dbe8-b9e7-4e0c-b7be-a8e789c6e715 req-70875a6b-daaa-4f72-9385-73770e2b842d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:51 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5387dbe8-b9e7-4e0c-b7be-a8e789c6e715 req-70875a6b-daaa-4f72-9385-73770e2b842d service nova] Creating event network-vif-plugged:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:23:51 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-5387dbe8-b9e7-4e0c-b7be-a8e789c6e715 req-70875a6b-daaa-4f72-9385-73770e2b842d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038011 Apr 14 04:23:51 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 147/443] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:23:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f963567f-b626-4a06-9d47-910c566c2721 req-753d9ef6-72d4-4ee8-aec2-391332914215 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f963567f-b626-4a06-9d47-910c566c2721 req-753d9ef6-72d4-4ee8-aec2-391332914215 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f963567f-b626-4a06-9d47-910c566c2721 req-753d9ef6-72d4-4ee8-aec2-391332914215 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f963567f-b626-4a06-9d47-910c566c2721 req-753d9ef6-72d4-4ee8-aec2-391332914215 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f963567f-b626-4a06-9d47-910c566c2721 req-753d9ef6-72d4-4ee8-aec2-391332914215 service nova] Creating event network-changed:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:23:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f963567f-b626-4a06-9d47-910c566c2721 req-753d9ef6-72d4-4ee8-aec2-391332914215 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033343 Apr 14 04:23:54 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 147/444] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:54 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:23:56 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-8993cfa1-fd42-4859-b76a-9604307e5608 req-525053ec-abc6-45c5-987a-ab1a0879dfb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-plugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:56 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:23:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-8993cfa1-fd42-4859-b76a-9604307e5608 req-525053ec-abc6-45c5-987a-ab1a0879dfb0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-8993cfa1-fd42-4859-b76a-9604307e5608 req-525053ec-abc6-45c5-987a-ab1a0879dfb0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:56 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-8993cfa1-fd42-4859-b76a-9604307e5608 req-525053ec-abc6-45c5-987a-ab1a0879dfb0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-8993cfa1-fd42-4859-b76a-9604307e5608 req-525053ec-abc6-45c5-987a-ab1a0879dfb0 service nova] Creating event network-vif-plugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:23:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-8993cfa1-fd42-4859-b76a-9604307e5608 req-525053ec-abc6-45c5-987a-ab1a0879dfb0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054048 Apr 14 04:23:56 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 151/445] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:23:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f23e63c8-6fd5-49ee-9278-b8e927086e46 req-d8d15639-24b5-4d15-9bb4-5565128e95f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-plugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:23:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f23e63c8-6fd5-49ee-9278-b8e927086e46 req-d8d15639-24b5-4d15-9bb4-5565128e95f1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:23:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f23e63c8-6fd5-49ee-9278-b8e927086e46 req-d8d15639-24b5-4d15-9bb4-5565128e95f1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:23:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f23e63c8-6fd5-49ee-9278-b8e927086e46 req-d8d15639-24b5-4d15-9bb4-5565128e95f1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:23:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f23e63c8-6fd5-49ee-9278-b8e927086e46 req-d8d15639-24b5-4d15-9bb4-5565128e95f1 service nova] Creating event network-vif-plugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:23:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f23e63c8-6fd5-49ee-9278-b8e927086e46 req-d8d15639-24b5-4d15-9bb4-5565128e95f1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038022 Apr 14 04:23:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 148/446] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:23:58 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=10 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4c95d7ab-2308-48ee-aeed-f7c83b9d1f99 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052973 Apr 14 04:24:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 148/447] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:24:01 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:24:03 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-10d14a9b-d3a4-4188-8556-951a7b1efb56 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServersNegativeTestJSON-server-649778492", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "destination_type": "local"}, {"source_type": "volume", "uuid": "edd9bf49-5c37-4c22-8cf8-beacd7d1aa81", "destination_type": "invalid"}], "networks": [{"uuid": "a462dbfb-12e1-48c7-a797-87823269af2a"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-10d14a9b-d3a4-4188-8556-951a7b1efb56 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Request method failure captured: Apr 14 04:24:03 user devstack@n-api.service[61596]: request: POST /compute/v2.1/servers HTTP/1.1 Apr 14 04:24:03 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:24:03 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:24:03 user devstack@n-api.service[61596]: Connection: close Apr 14 04:24:03 user devstack@n-api.service[61596]: Content-Length: 493 Apr 14 04:24:03 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:24:03 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:24:03 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:24:03 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOWSWL2iiuqjOKVXicFpVq3QynyS329JzabhIMRpTcE4u2nhOOGF_8pA3phEwF4Flx1eAEwXHOb4fAgQReFoofQtjbUxZflJc81TLe9wZ0GQOPZGEM5aHjAJmm_B5CLyBoVmu0QB2gRz5uHILI8GGX6hRONCaH8BhaaF5BW5Tr45I8 Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Project-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Project-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bae0fb4af555422a847620627dffeae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}] Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Tenant: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Tenant-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:24:03 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:24:03 user devstack@n-api.service[61596]: X-User: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:24:03 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:24:03 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:24:03 user devstack@n-api.service[61596]: X-User-Id: ea68fb139b004f748cf1bcfb8d675a2e Apr 14 04:24:03 user devstack@n-api.service[61596]: X-User-Name: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:24:03 user devstack@n-api.service[61596]: Apr 14 04:24:03 user devstack@n-api.service[61596]: {"server": {"name": "tempest-ServersNegativeTestJSON-server-649778492", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "block_device_mapping_v2": [{"source_type": "image", "delete_on_termination": true, "boot_index": 0, "uuid": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "destination_type": "local"}, {"source_type": "volume", "uuid": "edd9bf49-5c37-4c22-8cf8-beacd7d1aa81", "destination_type": "invalid"}], "networks": [{"uuid": "a462dbfb-12e1-48c7-a797-87823269af2a"}]}} Apr 14 04:24:03 user devstack@n-api.service[61596]: method: > Apr 14 04:24:03 user devstack@n-api.service[61596]: exception: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 04:24:03 user devstack@n-api.service[61596]: action_args: {'body': {'server': {'name': 'tempest-ServersNegativeTestJSON-server-649778492', 'imageRef': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'flavorRef': '42', 'block_device_mapping_v2': [{'source_type': 'image', 'delete_on_termination': True, 'boot_index': 0, 'uuid': '5c55a1da-f6f8-4442-939b-f0cb72ea4327', 'destination_type': 'local'}, {'source_type': 'volume', 'uuid': 'edd9bf49-5c37-4c22-8cf8-beacd7d1aa81', 'destination_type': 'invalid'}], 'networks': [{'uuid': 'a462dbfb-12e1-48c7-a797-87823269af2a'}]}}} Apr 14 04:24:03 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise error Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 'invalid' is not one of ['local', 'volume'] Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Failed validating 'enum' in schema['properties']['server']['properties']['block_device_mapping_v2']['items']['properties']['destination_type']: Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi {'enum': ['local', 'volume'], 'type': 'string'} Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi On instance['server']['block_device_mapping_v2'][1]: Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi 'invalid' Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] Apr 14 04:24:03 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:24:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-10d14a9b-d3a4-4188-8556-951a7b1efb56 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Returning 400 to user: Invalid input for field/attribute destination_type. Value: invalid. 'invalid' is not one of ['local', 'volume'] {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:24:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-10d14a9b-d3a4-4188-8556-951a7b1efb56 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 400 len: 155 microversion: 2.1 time: 0.013190 Apr 14 04:24:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 152/448] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:24:03 2023] POST /compute/v2.1/servers => generated 155 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:03 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:03 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a5d76b08-95b0-448c-9d75-096d0f58818c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 200 len: 1494 microversion: 2.1 time: 0.194612 Apr 14 04:24:03 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 149/449] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:03 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 1494 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:05 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1113e3bd-c41e-42e2-aa03-57986e92d695 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '.version_select at 0x7f538aea6440>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1113e3bd-c41e-42e2-aa03-57986e92d695 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "DELETE /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8" status: 204 len: 0 microversion: 2.1 time: 0.233003 Apr 14 04:24:05 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 149/450] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:05 2023] DELETE /compute/v2.1/images/91fd17de-3c0e-4dfd-bb7c-1f98b14aaeb8 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:05 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:24:05 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b5441c7a-4783-4209-bba9-e60c55917de0 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 204 len: 0 microversion: 2.1 time: 0.135115 Apr 14 04:24:05 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 153/451] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:24:05 2023] DELETE /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:05 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '676d80d3684045298d895555247174af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '15bb9ddec81e4f6cbceb6ce7dee9c3a1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-93df8758-0c0e-450f-bc9a-e048ca8059b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 200 len: 1678 microversion: 2.1 time: 0.270501 Apr 14 04:24:05 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 150/452] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:05 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:24:05 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f3de1a0c-990f-4ee9-b96b-914b1e3a5437 req-81d7a2df-040e-47a1-a38f-789b980d0659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-unplugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:05 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=36,nova_api:INSERT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f3de1a0c-990f-4ee9-b96b-914b1e3a5437 req-81d7a2df-040e-47a1-a38f-789b980d0659 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f3de1a0c-990f-4ee9-b96b-914b1e3a5437 req-81d7a2df-040e-47a1-a38f-789b980d0659 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f3de1a0c-990f-4ee9-b96b-914b1e3a5437 req-81d7a2df-040e-47a1-a38f-789b980d0659 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f3de1a0c-990f-4ee9-b96b-914b1e3a5437 req-81d7a2df-040e-47a1-a38f-789b980d0659 service nova] Creating event network-vif-unplugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:24:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f3de1a0c-990f-4ee9-b96b-914b1e3a5437 req-81d7a2df-040e-47a1-a38f-789b980d0659 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036221 Apr 14 04:24:05 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 150/453] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:05 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-fbb2a2c2-d7b4-4f05-a4da-efd1124add7e req-a838604d-34ae-4f17-a188-cb6f69a8d094 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-deleted", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-fbb2a2c2-d7b4-4f05-a4da-efd1124add7e req-a838604d-34ae-4f17-a188-cb6f69a8d094 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-fbb2a2c2-d7b4-4f05-a4da-efd1124add7e req-a838604d-34ae-4f17-a188-cb6f69a8d094 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-fbb2a2c2-d7b4-4f05-a4da-efd1124add7e req-a838604d-34ae-4f17-a188-cb6f69a8d094 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-fbb2a2c2-d7b4-4f05-a4da-efd1124add7e req-a838604d-34ae-4f17-a188-cb6f69a8d094 service nova] Creating event network-vif-deleted:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:24:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-fbb2a2c2-d7b4-4f05-a4da-efd1124add7e req-a838604d-34ae-4f17-a188-cb6f69a8d094 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036273 Apr 14 04:24:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 154/454] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-90f48607-950c-4252-ad5b-78a63f13dac3 req-d80de21a-cd11-4d48-88dc-b5289fafecef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cd60eede-cd79-4c1b-adb7-ba7c6cbc9659", "name": "network-vif-plugged", "status": "completed", "tag": "0c62956f-a2d8-4932-b48f-469eba99b8e6"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-90f48607-950c-4252-ad5b-78a63f13dac3 req-d80de21a-cd11-4d48-88dc-b5289fafecef service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-90f48607-950c-4252-ad5b-78a63f13dac3 req-d80de21a-cd11-4d48-88dc-b5289fafecef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-90f48607-950c-4252-ad5b-78a63f13dac3 req-d80de21a-cd11-4d48-88dc-b5289fafecef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-90f48607-950c-4252-ad5b-78a63f13dac3 req-d80de21a-cd11-4d48-88dc-b5289fafecef service nova] Creating event network-vif-plugged:0c62956f-a2d8-4932-b48f-469eba99b8e6 for instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 on user Apr 14 04:24:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-90f48607-950c-4252-ad5b-78a63f13dac3 req-d80de21a-cd11-4d48-88dc-b5289fafecef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030742 Apr 14 04:24:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 151/455] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:10 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0f9f0bc8-d755-4aa8-b175-70fd6c0c1fd5 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 200 len: 1505 microversion: 2.1 time: 0.158166 Apr 14 04:24:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 151/456] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:10 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 1505 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:11 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-807cc437-483e-4715-b3e1-0fe5923f965f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-807cc437-483e-4715-b3e1-0fe5923f965f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-807cc437-483e-4715-b3e1-0fe5923f965f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-807cc437-483e-4715-b3e1-0fe5923f965f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:11 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-807cc437-483e-4715-b3e1-0fe5923f965f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Going to try to start instance {{(pid=61596) start /opt/stack/nova/nova/compute/api.py:2787}} Apr 14 04:24:11 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-807cc437-483e-4715-b3e1-0fe5923f965f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action" status: 202 len: 0 microversion: 2.1 time: 0.065701 Apr 14 04:24:11 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 155/457] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:24:11 2023] POST /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/action => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:12 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d604920f-5fdd-4aef-8716-2491ff01f3e9 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1653 microversion: 2.1 time: 0.192567 Apr 14 04:24:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 152/458] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:11 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1653 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1117599705", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "blank", "volume_size": 1, "destination_type": "volume"}], "networks": [{"uuid": "7457ae38-8cd9-4172-aa34-25b764436aee"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:14 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] validate_networks() for [('7457ae38-8cd9-4172-aa34-25b764436aee', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:24:14 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-195660a4-c391-4fb5-a88d-0f158742d383 req-f9680831-5e61-41d5-af25-fbb0e532285c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-195660a4-c391-4fb5-a88d-0f158742d383 req-f9680831-5e61-41d5-af25-fbb0e532285c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-195660a4-c391-4fb5-a88d-0f158742d383 req-f9680831-5e61-41d5-af25-fbb0e532285c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-195660a4-c391-4fb5-a88d-0f158742d383 req-f9680831-5e61-41d5-af25-fbb0e532285c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:14 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-195660a4-c391-4fb5-a88d-0f158742d383 req-f9680831-5e61-41d5-af25-fbb0e532285c service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:24:14 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-195660a4-c391-4fb5-a88d-0f158742d383 req-f9680831-5e61-41d5-af25-fbb0e532285c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035488 Apr 14 04:24:14 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 156/459] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=27 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for user 6ec7103e06e643a6b9b2c908ba8d7b06 and project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:24:15 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='blank',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:24:15 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-cd573453-2dee-4d84-8124-4274af07943e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.730437 Apr 14 04:24:15 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 152/460] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 04:24:14 2023] POST /compute/v2.1/servers => generated 378 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:24:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-6ba023b0-e36b-4168-bce9-1f6ede2100e5 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:15 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-6ba023b0-e36b-4168-bce9-1f6ede2100e5 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:15 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-6ba023b0-e36b-4168-bce9-1f6ede2100e5 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:15 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-6ba023b0-e36b-4168-bce9-1f6ede2100e5 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:15 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-6ba023b0-e36b-4168-bce9-1f6ede2100e5 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-6ba023b0-e36b-4168-bce9-1f6ede2100e5 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 200 len: 1395 microversion: 2.87 time: 0.108026 Apr 14 04:24:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 153/461] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:24:15 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 1395 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:24:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-cbff7dd2-2e45-42fe-90c5-d81e04f5be6e req-fc11e447-2b41-40ef-9639-0744a8777273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cbff7dd2-2e45-42fe-90c5-d81e04f5be6e req-fc11e447-2b41-40ef-9639-0744a8777273 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cbff7dd2-2e45-42fe-90c5-d81e04f5be6e req-fc11e447-2b41-40ef-9639-0744a8777273 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cbff7dd2-2e45-42fe-90c5-d81e04f5be6e req-fc11e447-2b41-40ef-9639-0744a8777273 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-cbff7dd2-2e45-42fe-90c5-d81e04f5be6e req-fc11e447-2b41-40ef-9639-0744a8777273 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:24:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-cbff7dd2-2e45-42fe-90c5-d81e04f5be6e req-fc11e447-2b41-40ef-9639-0744a8777273 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058805 Apr 14 04:24:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 157/462] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:19 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-07b64e28-0f60-466c-ae7f-42a73051d4cc req-dc493891-844a-49f1-b846-af7c33fa5b87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-07b64e28-0f60-466c-ae7f-42a73051d4cc req-dc493891-844a-49f1-b846-af7c33fa5b87 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-07b64e28-0f60-466c-ae7f-42a73051d4cc req-dc493891-844a-49f1-b846-af7c33fa5b87 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-07b64e28-0f60-466c-ae7f-42a73051d4cc req-dc493891-844a-49f1-b846-af7c33fa5b87 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:19 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-07b64e28-0f60-466c-ae7f-42a73051d4cc req-dc493891-844a-49f1-b846-af7c33fa5b87 service nova] Creating event network-changed:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:24:19 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-07b64e28-0f60-466c-ae7f-42a73051d4cc req-dc493891-844a-49f1-b846-af7c33fa5b87 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038054 Apr 14 04:24:19 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 153/463] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=26 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:20 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2561bbc0c6d447da333ffdbb9fdc5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d389bb78d2e40b9b07d2d3ecdb7566b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:20 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-33efaf46-825b-4905-be5f-073b494e8a0e tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55" status: 200 len: 1497 microversion: 2.1 time: 0.199709 Apr 14 04:24:20 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 154/464] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:20 2023] GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 => generated 1497 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-876fed3b-541c-4acf-987f-83527c0ddc24 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050165 Apr 14 04:24:22 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 158/465] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:24:22 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:22 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2acc79b5-ffe9-49cb-a239-99d112994026 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1675 microversion: 2.1 time: 0.155821 Apr 14 04:24:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 154/466] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:22 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1675 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:23 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-59c47287-ad45-4c2e-9fa7-7a71e30c1d75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1675 microversion: 2.1 time: 0.147800 Apr 14 04:24:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 155/467] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:22 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1675 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:23 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:23 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-dc7df6c6-bb29-4137-9f7a-a97ab5ed61ab tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1675 microversion: 2.1 time: 0.157274 Apr 14 04:24:23 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 159/468] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:23 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "de74dbb1-1657-4193-9520-50cfa823199b", "device": "/dev/vdb"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-defcc02b-34a3-45f3-911a-b8757e910851 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "POST /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.337809 Apr 14 04:24:29 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 155/469] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:24:29 2023] POST /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:29 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-e0c16108-c8f6-4114-9b30-1b5ffe81327f req-47b092dd-c109-4922-9115-12ba53b6d936 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:29 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0c16108-c8f6-4114-9b30-1b5ffe81327f req-47b092dd-c109-4922-9115-12ba53b6d936 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0c16108-c8f6-4114-9b30-1b5ffe81327f req-47b092dd-c109-4922-9115-12ba53b6d936 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0c16108-c8f6-4114-9b30-1b5ffe81327f req-47b092dd-c109-4922-9115-12ba53b6d936 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-e0c16108-c8f6-4114-9b30-1b5ffe81327f req-47b092dd-c109-4922-9115-12ba53b6d936 service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:24:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-e0c16108-c8f6-4114-9b30-1b5ffe81327f req-47b092dd-c109-4922-9115-12ba53b6d936 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043294 Apr 14 04:24:29 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 156/470] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-001142bc-ca35-4d09-a5af-d98df59f4307 req-a7b6d1e9-1a4d-4ad7-9843-9aba6df964c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-001142bc-ca35-4d09-a5af-d98df59f4307 req-a7b6d1e9-1a4d-4ad7-9843-9aba6df964c2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-001142bc-ca35-4d09-a5af-d98df59f4307 req-a7b6d1e9-1a4d-4ad7-9843-9aba6df964c2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-001142bc-ca35-4d09-a5af-d98df59f4307 req-a7b6d1e9-1a4d-4ad7-9843-9aba6df964c2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-001142bc-ca35-4d09-a5af-d98df59f4307 req-a7b6d1e9-1a4d-4ad7-9843-9aba6df964c2 service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:24:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-001142bc-ca35-4d09-a5af-d98df59f4307 req-a7b6d1e9-1a4d-4ad7-9843-9aba6df964c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 Apr 14 04:24:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 160/471] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:31 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:34 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3c1b814ec240279646878fd090f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39731dbb51484eff890a74b07241ba75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:34 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-57b8e436-82b9-4e20-ad2c-0738ec13c642 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066" status: 200 len: 1567 microversion: 2.1 time: 0.178167 Apr 14 04:24:34 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 156/472] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:34 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066 => generated 1567 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=13 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=13 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:41 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fc262a30-b41a-49a1-80ea-9d38be227765 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1534 microversion: 2.1 time: 0.154841 Apr 14 04:24:41 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 157/473] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:41 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1534 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] [instance: 46a5fd77-abec-4ab3-b519-7c649e63459c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:45 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] [instance: 46a5fd77-abec-4ab3-b519-7c649e63459c] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:24:45 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-416794ea-9f01-4a9c-95f5-11f751b1b520 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c" status: 204 len: 0 microversion: 2.1 time: 0.124621 Apr 14 04:24:45 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 161/474] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:24:45 2023] DELETE /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] [instance: 46a5fd77-abec-4ab3-b519-7c649e63459c] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:45 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '275086d3eec449678b6b5ba6f3f887b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3f45f01678f747268221c00f75924c69', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:45 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-19f9d640-afb5-4f9f-b31b-6d20140d8eb6 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c" status: 200 len: 1460 microversion: 2.1 time: 0.242611 Apr 14 04:24:45 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 157/475] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:45 2023] GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c => generated 1460 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:45 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-97fc71a0-784a-4d80-9401-d70986d991b9 req-ad27d33b-c0bb-4cfd-bc55-5de7735c963c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a5fd77-abec-4ab3-b519-7c649e63459c", "name": "network-vif-unplugged", "status": "completed", "tag": "534d2295-4787-4bd1-9e53-4cf6acbf4a2b"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-97fc71a0-784a-4d80-9401-d70986d991b9 req-ad27d33b-c0bb-4cfd-bc55-5de7735c963c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-97fc71a0-784a-4d80-9401-d70986d991b9 req-ad27d33b-c0bb-4cfd-bc55-5de7735c963c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:45 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-97fc71a0-784a-4d80-9401-d70986d991b9 req-ad27d33b-c0bb-4cfd-bc55-5de7735c963c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-97fc71a0-784a-4d80-9401-d70986d991b9 req-ad27d33b-c0bb-4cfd-bc55-5de7735c963c service nova] Creating event network-vif-unplugged:534d2295-4787-4bd1-9e53-4cf6acbf4a2b for instance 46a5fd77-abec-4ab3-b519-7c649e63459c on user Apr 14 04:24:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-97fc71a0-784a-4d80-9401-d70986d991b9 req-ad27d33b-c0bb-4cfd-bc55-5de7735c963c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030261 Apr 14 04:24:45 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 158/476] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:45 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6e705004-b9e9-4107-afb1-86f913c52b2d req-d8790fc5-3d44-47a0-a7ce-126e464b74f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46a5fd77-abec-4ab3-b519-7c649e63459c", "name": "network-vif-plugged", "status": "completed", "tag": "534d2295-4787-4bd1-9e53-4cf6acbf4a2b"}, {"server_uuid": "46a5fd77-abec-4ab3-b519-7c649e63459c", "name": "network-vif-deleted", "tag": "534d2295-4787-4bd1-9e53-4cf6acbf4a2b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6e705004-b9e9-4107-afb1-86f913c52b2d req-d8790fc5-3d44-47a0-a7ce-126e464b74f2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6e705004-b9e9-4107-afb1-86f913c52b2d req-d8790fc5-3d44-47a0-a7ce-126e464b74f2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6e705004-b9e9-4107-afb1-86f913c52b2d req-d8790fc5-3d44-47a0-a7ce-126e464b74f2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6e705004-b9e9-4107-afb1-86f913c52b2d req-d8790fc5-3d44-47a0-a7ce-126e464b74f2 service nova] Creating event network-vif-plugged:534d2295-4787-4bd1-9e53-4cf6acbf4a2b for instance 46a5fd77-abec-4ab3-b519-7c649e63459c on user Apr 14 04:24:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6e705004-b9e9-4107-afb1-86f913c52b2d req-d8790fc5-3d44-47a0-a7ce-126e464b74f2 service nova] Creating event network-vif-deleted:534d2295-4787-4bd1-9e53-4cf6acbf4a2b for instance 46a5fd77-abec-4ab3-b519-7c649e63459c on user Apr 14 04:24:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6e705004-b9e9-4107-afb1-86f913c52b2d req-d8790fc5-3d44-47a0-a7ce-126e464b74f2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.030527 Apr 14 04:24:47 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 162/477] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:47 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lazy-loading 'services' on Instance uuid 97392a47-53f0-4bde-977a-e2945332fe1f {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:24:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6c88e981-9c2c-44b0-b2ea-f63b39c7488e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f/os-volume_attachments/de74dbb1-1657-4193-9520-50cfa823199b" status: 202 len: 0 microversion: 2.1 time: 0.167987 Apr 14 04:24:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 158/478] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:24:55 2023] DELETE /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f/os-volume_attachments/de74dbb1-1657-4193-9520-50cfa823199b => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:24:55 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-434df4c2-881f-4306-89d1-ca4b9064f991 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f" status: 204 len: 0 microversion: 2.1 time: 0.137030 Apr 14 04:24:55 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 159/479] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:24:55 2023] DELETE /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] [instance: cd60eede-cd79-4c1b-adb7-ba7c6cbc9659] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] HTTP exception thrown: Instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 could not be found. Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Request method failure captured: Apr 14 04:24:55 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 HTTP/1.1 Apr 14 04:24:55 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:24:55 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:24:55 user devstack@n-api.service[61595]: Connection: close Apr 14 04:24:55 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:24:55 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:24:55 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:24:55 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:24:55 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOl6qCUdT4piT_X2PbanueVRXznHuMG-iMqaFbLYtx8A5Yk6PNnp7rf2DDUhRGc6FdYf_uJYSHZ9fiL4sglcJ3AWXX26K0zYYvqfFwalK-SHr1sq6hW_kLSFDMcdGQgIGbkWYHiqiOYpXCvXCmYg4KNkxGB4FKfqWF2ZEJABT2lAMQ Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Project-Id: 15bb9ddec81e4f6cbceb6ce7dee9c3a1 Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServerStableDeviceRescueTest-1018370864 Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/15bb9ddec81e4f6cbceb6ce7dee9c3a1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15bb9ddec81e4f6cbceb6ce7dee9c3a1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/15bb9ddec81e4f6cbceb6ce7dee9c3a1"}]}] Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Tenant: tempest-ServerStableDeviceRescueTest-1018370864 Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Tenant-Id: 15bb9ddec81e4f6cbceb6ce7dee9c3a1 Apr 14 04:24:55 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServerStableDeviceRescueTest-1018370864 Apr 14 04:24:55 user devstack@n-api.service[61595]: X-User: tempest-ServerStableDeviceRescueTest-1018370864-project-member Apr 14 04:24:55 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:24:55 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:24:55 user devstack@n-api.service[61595]: X-User-Id: 676d80d3684045298d895555247174af Apr 14 04:24:55 user devstack@n-api.service[61595]: X-User-Name: tempest-ServerStableDeviceRescueTest-1018370864-project-member Apr 14 04:24:55 user devstack@n-api.service[61595]: method: > Apr 14 04:24:55 user devstack@n-api.service[61595]: exception: Instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 could not be found. Apr 14 04:24:55 user devstack@n-api.service[61595]: action_args: {'id': 'cd60eede-cd79-4c1b-adb7-ba7c6cbc9659'} Apr 14 04:24:55 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 could not be found. Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 could not be found. Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 could not be found. Apr 14 04:24:55 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:24:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Returning 404 to user: Instance cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:24:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-e9709e76-1676-49c4-8d9c-d24df7e653b3 tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659" status: 404 len: 111 microversion: 2.1 time: 0.028933 Apr 14 04:24:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 159/480] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:55 2023] GET /compute/v2.1/servers/cd60eede-cd79-4c1b-adb7-ba7c6cbc9659 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:24:55 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3407da27-22e6-4667-aca5-9882f85f905e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] Calling method '.version_select at 0x7f538ac7ec20>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:24:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3407da27-22e6-4667-aca5-9882f85f905e tempest-ServerStableDeviceRescueTest-1018370864 tempest-ServerStableDeviceRescueTest-1018370864-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-234703296" status: 202 len: 0 microversion: 2.1 time: 0.026292 Apr 14 04:24:56 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 160/481] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 04:24:55 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-234703296 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:24:56 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a70281d6734c15b3c4b1b00e4b5d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848c9a67e2746e5b12b73920215b729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:24:56 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d0104042-a416-4bdc-aa70-9ecfa50e625e tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f" status: 200 len: 1548 microversion: 2.1 time: 0.196390 Apr 14 04:24:56 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 163/482] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:24:55 2023] GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f => generated 1548 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:24:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-3befa2ba-34c6-43e3-bf8d-4a5d471580e2 req-d14e564d-2b0d-4046-b5b2-be2a80a0c167 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97392a47-53f0-4bde-977a-e2945332fe1f", "name": "network-vif-unplugged", "status": "completed", "tag": "32f6910c-738f-4bbd-bd2a-a2d1b9bc261d"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3befa2ba-34c6-43e3-bf8d-4a5d471580e2 req-d14e564d-2b0d-4046-b5b2-be2a80a0c167 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3befa2ba-34c6-43e3-bf8d-4a5d471580e2 req-d14e564d-2b0d-4046-b5b2-be2a80a0c167 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3befa2ba-34c6-43e3-bf8d-4a5d471580e2 req-d14e564d-2b0d-4046-b5b2-be2a80a0c167 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-3befa2ba-34c6-43e3-bf8d-4a5d471580e2 req-d14e564d-2b0d-4046-b5b2-be2a80a0c167 service nova] Creating event network-vif-unplugged:32f6910c-738f-4bbd-bd2a-a2d1b9bc261d for instance 97392a47-53f0-4bde-977a-e2945332fe1f on user Apr 14 04:24:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-3befa2ba-34c6-43e3-bf8d-4a5d471580e2 req-d14e564d-2b0d-4046-b5b2-be2a80a0c167 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031173 Apr 14 04:24:58 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 160/483] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:57 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:24:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-052aefe8-1b79-428c-bbcb-216845e8c44c req-9cbc5e5a-da87-4b35-acbe-25bf36357399 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97392a47-53f0-4bde-977a-e2945332fe1f", "name": "network-vif-deleted", "tag": "32f6910c-738f-4bbd-bd2a-a2d1b9bc261d"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:24:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-052aefe8-1b79-428c-bbcb-216845e8c44c req-9cbc5e5a-da87-4b35-acbe-25bf36357399 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:24:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-052aefe8-1b79-428c-bbcb-216845e8c44c req-9cbc5e5a-da87-4b35-acbe-25bf36357399 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:24:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-052aefe8-1b79-428c-bbcb-216845e8c44c req-9cbc5e5a-da87-4b35-acbe-25bf36357399 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:24:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-052aefe8-1b79-428c-bbcb-216845e8c44c req-9cbc5e5a-da87-4b35-acbe-25bf36357399 service nova] Creating event network-vif-deleted:32f6910c-738f-4bbd-bd2a-a2d1b9bc261d for instance 97392a47-53f0-4bde-977a-e2945332fe1f on user Apr 14 04:24:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-052aefe8-1b79-428c-bbcb-216845e8c44c req-9cbc5e5a-da87-4b35-acbe-25bf36357399 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035465 Apr 14 04:24:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 161/484] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:24:59 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-5bcb3ae4-9e93-46d3-a483-0ed406876121 req-32b64e7f-8e70-4922-8b0b-d856562d3e84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "97392a47-53f0-4bde-977a-e2945332fe1f", "name": "network-vif-plugged", "status": "completed", "tag": "32f6910c-738f-4bbd-bd2a-a2d1b9bc261d"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5bcb3ae4-9e93-46d3-a483-0ed406876121 req-32b64e7f-8e70-4922-8b0b-d856562d3e84 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5bcb3ae4-9e93-46d3-a483-0ed406876121 req-32b64e7f-8e70-4922-8b0b-d856562d3e84 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5bcb3ae4-9e93-46d3-a483-0ed406876121 req-32b64e7f-8e70-4922-8b0b-d856562d3e84 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5bcb3ae4-9e93-46d3-a483-0ed406876121 req-32b64e7f-8e70-4922-8b0b-d856562d3e84 service nova] Creating event network-vif-plugged:32f6910c-738f-4bbd-bd2a-a2d1b9bc261d for instance 97392a47-53f0-4bde-977a-e2945332fe1f on user Apr 14 04:25:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-5bcb3ae4-9e93-46d3-a483-0ed406876121 req-32b64e7f-8e70-4922-8b0b-d856562d3e84 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036574 Apr 14 04:25:00 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 164/485] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:02 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-c3d13b34-33aa-4109-86ef-49d69f6f471c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1657 microversion: 2.1 time: 0.148026 Apr 14 04:25:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 161/486] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:02 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1657 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:05 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-7f6844d1-f83b-4896-aaac-989775be9fd0 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 200 len: 1770 microversion: 2.87 time: 0.277669 Apr 14 04:25:05 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 162/487] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:25:05 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 1770 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] HTTP exception thrown: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Request method failure captured: Apr 14 04:25:10 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 HTTP/1.1 Apr 14 04:25:10 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:25:10 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:25:10 user devstack@n-api.service[61596]: Connection: close Apr 14 04:25:10 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:25:10 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:25:10 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:25:10 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:25:10 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOWSWL2iiuqjOKVXicFpVq3QynyS329JzabhIMRpTcE4u2nhOOGF_8pA3phEwF4Flx1eAEwXHOb4fAgQReFoofQtjbUxZflJc81TLe9wZ0GQOPZGEM5aHjAJmm_B5CLyBoVmu0QB2gRz5uHILI8GGX6hRONCaH8BhaaF5BW5Tr45I8 Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Project-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Project-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bae0fb4af555422a847620627dffeae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}] Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Tenant: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Tenant-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:25:10 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:25:10 user devstack@n-api.service[61596]: X-User: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:25:10 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:25:10 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:25:10 user devstack@n-api.service[61596]: X-User-Id: ea68fb139b004f748cf1bcfb8d675a2e Apr 14 04:25:10 user devstack@n-api.service[61596]: X-User-Name: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:25:10 user devstack@n-api.service[61596]: method: > Apr 14 04:25:10 user devstack@n-api.service[61596]: exception: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61596]: action_args: {'id': '59e547de-a74b-4ccd-90de-e7b61cba6964'} Apr 14 04:25:10 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Returning 404 to user: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:25:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7bb0faac-b0b0-4c7f-a283-473785f33cce tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964" status: 404 len: 111 microversion: 2.1 time: 0.037007 Apr 14 04:25:10 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 165/488] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:25:10 2023] DELETE /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 59e547de-a74b-4ccd-90de-e7b61cba6964] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] HTTP exception thrown: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Request method failure captured: Apr 14 04:25:10 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 HTTP/1.1 Apr 14 04:25:10 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:25:10 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:25:10 user devstack@n-api.service[61595]: Connection: close Apr 14 04:25:10 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:25:10 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:25:10 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:25:10 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:25:10 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOWSWL2iiuqjOKVXicFpVq3QynyS329JzabhIMRpTcE4u2nhOOGF_8pA3phEwF4Flx1eAEwXHOb4fAgQReFoofQtjbUxZflJc81TLe9wZ0GQOPZGEM5aHjAJmm_B5CLyBoVmu0QB2gRz5uHILI8GGX6hRONCaH8BhaaF5BW5Tr45I8 Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Project-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bae0fb4af555422a847620627dffeae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}] Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Tenant: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Tenant-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:25:10 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:25:10 user devstack@n-api.service[61595]: X-User: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:25:10 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:25:10 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:25:10 user devstack@n-api.service[61595]: X-User-Id: ea68fb139b004f748cf1bcfb8d675a2e Apr 14 04:25:10 user devstack@n-api.service[61595]: X-User-Name: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:25:10 user devstack@n-api.service[61595]: method: > Apr 14 04:25:10 user devstack@n-api.service[61595]: exception: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61595]: action_args: {'id': '59e547de-a74b-4ccd-90de-e7b61cba6964'} Apr 14 04:25:10 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. Apr 14 04:25:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Returning 404 to user: Instance 59e547de-a74b-4ccd-90de-e7b61cba6964 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:25:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-da3bfe1c-c288-4df8-9e52-df6442e7dad5 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964" status: 404 len: 111 microversion: 2.1 time: 0.028918 Apr 14 04:25:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 162/489] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:10 2023] GET /compute/v2.1/servers/59e547de-a74b-4ccd-90de-e7b61cba6964 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:25:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-368c135b-674b-4bad-9850-d373af76294b tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 204 len: 0 microversion: 2.1 time: 0.127049 Apr 14 04:25:10 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 163/490] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:25:10 2023] DELETE /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea68fb139b004f748cf1bcfb8d675a2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bae0fb4af555422a847620627dffeae8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c084b328-c4af-409b-8f5b-c1523745ae9c tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 200 len: 1500 microversion: 2.1 time: 0.284022 Apr 14 04:25:10 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 166/491] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:10 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 1500 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-df6e188f-ea0f-478a-9b8b-0aba5bc82d40 req-1c09fd1b-a5f8-41c4-9aa5-2b03161b97cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b532a44-20b7-4590-babe-684c49598a62", "name": "network-vif-unplugged", "status": "completed", "tag": "c45f9c53-8d5c-4b47-8e0a-ebb292cefb06"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-df6e188f-ea0f-478a-9b8b-0aba5bc82d40 req-1c09fd1b-a5f8-41c4-9aa5-2b03161b97cc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-df6e188f-ea0f-478a-9b8b-0aba5bc82d40 req-1c09fd1b-a5f8-41c4-9aa5-2b03161b97cc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-df6e188f-ea0f-478a-9b8b-0aba5bc82d40 req-1c09fd1b-a5f8-41c4-9aa5-2b03161b97cc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-df6e188f-ea0f-478a-9b8b-0aba5bc82d40 req-1c09fd1b-a5f8-41c4-9aa5-2b03161b97cc service nova] Creating event network-vif-unplugged:c45f9c53-8d5c-4b47-8e0a-ebb292cefb06 for instance 9b532a44-20b7-4590-babe-684c49598a62 on user Apr 14 04:25:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-df6e188f-ea0f-478a-9b8b-0aba5bc82d40 req-1c09fd1b-a5f8-41c4-9aa5-2b03161b97cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037872 Apr 14 04:25:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 163/492] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:10 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-b91abdff-0c1c-4bde-a24d-bb4de7bfab30 req-d8bcae77-4e53-4cdc-b336-17568bfdb091 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b532a44-20b7-4590-babe-684c49598a62", "name": "network-vif-deleted", "tag": "c45f9c53-8d5c-4b47-8e0a-ebb292cefb06"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b91abdff-0c1c-4bde-a24d-bb4de7bfab30 req-d8bcae77-4e53-4cdc-b336-17568bfdb091 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b91abdff-0c1c-4bde-a24d-bb4de7bfab30 req-d8bcae77-4e53-4cdc-b336-17568bfdb091 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b91abdff-0c1c-4bde-a24d-bb4de7bfab30 req-d8bcae77-4e53-4cdc-b336-17568bfdb091 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-b91abdff-0c1c-4bde-a24d-bb4de7bfab30 req-d8bcae77-4e53-4cdc-b336-17568bfdb091 service nova] Creating event network-vif-deleted:c45f9c53-8d5c-4b47-8e0a-ebb292cefb06 for instance 9b532a44-20b7-4590-babe-684c49598a62 on user Apr 14 04:25:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-b91abdff-0c1c-4bde-a24d-bb4de7bfab30 req-d8bcae77-4e53-4cdc-b336-17568bfdb091 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031122 Apr 14 04:25:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 164/493] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:12 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-c23d70ac-8c8d-4217-a4b7-11d85269c8bb req-05414f7c-1383-4a2f-8d95-6f79a5b833b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9b532a44-20b7-4590-babe-684c49598a62", "name": "network-vif-plugged", "status": "completed", "tag": "c45f9c53-8d5c-4b47-8e0a-ebb292cefb06"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c23d70ac-8c8d-4217-a4b7-11d85269c8bb req-05414f7c-1383-4a2f-8d95-6f79a5b833b0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c23d70ac-8c8d-4217-a4b7-11d85269c8bb req-05414f7c-1383-4a2f-8d95-6f79a5b833b0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c23d70ac-8c8d-4217-a4b7-11d85269c8bb req-05414f7c-1383-4a2f-8d95-6f79a5b833b0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-c23d70ac-8c8d-4217-a4b7-11d85269c8bb req-05414f7c-1383-4a2f-8d95-6f79a5b833b0 service nova] Creating event network-vif-plugged:c45f9c53-8d5c-4b47-8e0a-ebb292cefb06 for instance 9b532a44-20b7-4590-babe-684c49598a62 on user Apr 14 04:25:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-c23d70ac-8c8d-4217-a4b7-11d85269c8bb req-05414f7c-1383-4a2f-8d95-6f79a5b833b0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028511 Apr 14 04:25:12 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 167/494] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2d67e708-c051-4c1c-a769-3f1b560f5584 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'create', calling method: .version_select at 0x7f538aea6440>, body: {"keypair": {"name": "tempest-keypair-1320453961", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCb+23dydPc8XvPesmHXUsmKMTGTpSa5GCZHGQJYeeij6pIqTWqaFg9yzcA/VhrLxaLND3aQCfGfHGfvo53ucWJsjWgHFiCEptESTMFy12g7udsn7vnD6U5hRBURzXxHFg=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:12 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-2d67e708-c051-4c1c-a769-3f1b560f5584 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:25:12 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-2d67e708-c051-4c1c-a769-3f1b560f5584 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for user 5234914aec8e443b8a38ac6b38729031 and project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:25:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2d67e708-c051-4c1c-a769-3f1b560f5584 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.043057 Apr 14 04:25:13 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 164/495] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:25:12 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1081038034", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "b413a761-e152-48ff-a963-b8e2cbab4a86"}], "security_groups": [{"name": "tempest-securitygroup--297226398"}], "key_name": "tempest-keypair-1320453961", "user_data": "}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] validate_networks() for [('b413a761-e152-48ff-a963-b8e2cbab4a86', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Getting quotas for user 5234914aec8e443b8a38ac6b38729031 and project 33320dc2f2c14ecfa5abf6574029c36c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:25:14 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:25:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2c104f98-c90d-4be3-bfbf-947f88452ec3 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.569460 Apr 14 04:25:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 165/496] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:25:14 2023] POST /compute/v2.1/servers => generated 406 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:25:14 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-72ac047b-e624-49b2-9638-82c9b71a3e10 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:14 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-72ac047b-e624-49b2-9638-82c9b71a3e10 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:15 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-72ac047b-e624-49b2-9638-82c9b71a3e10 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-72ac047b-e624-49b2-9638-82c9b71a3e10 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 200 len: 1240 microversion: 2.1 time: 0.077787 Apr 14 04:25:15 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 168/497] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:14 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 1240 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:17 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-3b27c5f4-95ca-427e-94bd-9a88f58da432 req-bdd9fe1d-ed90-4b00-9221-5d37c19118fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3b27c5f4-95ca-427e-94bd-9a88f58da432 req-bdd9fe1d-ed90-4b00-9221-5d37c19118fd service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3b27c5f4-95ca-427e-94bd-9a88f58da432 req-bdd9fe1d-ed90-4b00-9221-5d37c19118fd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-3b27c5f4-95ca-427e-94bd-9a88f58da432 req-bdd9fe1d-ed90-4b00-9221-5d37c19118fd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-3b27c5f4-95ca-427e-94bd-9a88f58da432 req-bdd9fe1d-ed90-4b00-9221-5d37c19118fd service nova] Creating event network-changed:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:25:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-3b27c5f4-95ca-427e-94bd-9a88f58da432 req-bdd9fe1d-ed90-4b00-9221-5d37c19118fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031115 Apr 14 04:25:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 165/498] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:17 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:25:19 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-3b27d63d-794f-46f7-bb84-426f778b8a9a req-6e230a6b-0430-4659-9166-20d61eb26bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3b27d63d-794f-46f7-bb84-426f778b8a9a req-6e230a6b-0430-4659-9166-20d61eb26bcb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3b27d63d-794f-46f7-bb84-426f778b8a9a req-6e230a6b-0430-4659-9166-20d61eb26bcb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3b27d63d-794f-46f7-bb84-426f778b8a9a req-6e230a6b-0430-4659-9166-20d61eb26bcb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-3b27d63d-794f-46f7-bb84-426f778b8a9a req-6e230a6b-0430-4659-9166-20d61eb26bcb service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:25:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-3b27d63d-794f-46f7-bb84-426f778b8a9a req-6e230a6b-0430-4659-9166-20d61eb26bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029256 Apr 14 04:25:19 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 166/499] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:21 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-39861b9d-85d9-4118-a34d-53e1dcb57ad8 req-ed0dd638-a582-4bde-92c9-dd6897cd5f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-39861b9d-85d9-4118-a34d-53e1dcb57ad8 req-ed0dd638-a582-4bde-92c9-dd6897cd5f12 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-39861b9d-85d9-4118-a34d-53e1dcb57ad8 req-ed0dd638-a582-4bde-92c9-dd6897cd5f12 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-39861b9d-85d9-4118-a34d-53e1dcb57ad8 req-ed0dd638-a582-4bde-92c9-dd6897cd5f12 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:21 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-39861b9d-85d9-4118-a34d-53e1dcb57ad8 req-ed0dd638-a582-4bde-92c9-dd6897cd5f12 service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:25:21 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-39861b9d-85d9-4118-a34d-53e1dcb57ad8 req-ed0dd638-a582-4bde-92c9-dd6897cd5f12 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029939 Apr 14 04:25:21 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 169/500] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Action: 'update', calling method: >, body: {"volumeAttachment": {"volumeId": "80fa232a-9074-4ca9-a62c-306fc14a6f35"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] HTTP exception thrown: Volume 34104442-d448-4fbf-9ce6-1eccac542dfb could not be found. Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Request method failure captured: Apr 14 04:25:22 user devstack@n-api.service[61595]: request: PUT /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55/os-volume_attachments/34104442-d448-4fbf-9ce6-1eccac542dfb HTTP/1.1 Apr 14 04:25:22 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:25:22 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:25:22 user devstack@n-api.service[61595]: Connection: close Apr 14 04:25:22 user devstack@n-api.service[61595]: Content-Length: 74 Apr 14 04:25:22 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:25:22 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:25:22 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:25:22 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONSMKJVj1zLBVLCSSU18DRsfXGqYJUblArDPO3vIGKk3rAPBLvBCwoARClO20_WuO10OAP6wbq3vanGKpNkjOWKDh6OvzMF7LalONt4P2rspxt6VyK0OyF0AqhChtGWnuDWAENTbNot2genqs30sFRHE_EEvXWpTlkQfuFPPGO9runc Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Project-Id: caeb562508c74a9aa49999eabeb79a84 Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesAdminNegativeTest-1895968812 Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Role: member,reader,admin Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Roles: member,reader,admin Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/caeb562508c74a9aa49999eabeb79a84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caeb562508c74a9aa49999eabeb79a84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/caeb562508c74a9aa49999eabeb79a84"}]}] Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesAdminNegativeTest-1895968812 Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Tenant-Id: caeb562508c74a9aa49999eabeb79a84 Apr 14 04:25:22 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-1895968812 Apr 14 04:25:22 user devstack@n-api.service[61595]: X-User: tempest-VolumesAdminNegativeTest-1895968812-project-admin Apr 14 04:25:22 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:25:22 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:25:22 user devstack@n-api.service[61595]: X-User-Id: ff9aa4b1f196460194f37b10747b7088 Apr 14 04:25:22 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesAdminNegativeTest-1895968812-project-admin Apr 14 04:25:22 user devstack@n-api.service[61595]: Apr 14 04:25:22 user devstack@n-api.service[61595]: {"volumeAttachment": {"volumeId": "80fa232a-9074-4ca9-a62c-306fc14a6f35"}} Apr 14 04:25:22 user devstack@n-api.service[61595]: method: > Apr 14 04:25:22 user devstack@n-api.service[61595]: exception: Volume 34104442-d448-4fbf-9ce6-1eccac542dfb could not be found. Apr 14 04:25:22 user devstack@n-api.service[61595]: action_args: {'server_id': '7ffb8a8e-b24f-46e8-84c4-130e9f18cf55', 'id': '34104442-d448-4fbf-9ce6-1eccac542dfb', 'body': {'volumeAttachment': {'volumeId': '80fa232a-9074-4ca9-a62c-306fc14a6f35'}}} Apr 14 04:25:22 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 34104442-d448-4fbf-9ce6-1eccac542dfb could not be found. (HTTP 404) (Request-ID: req-12aecfc4-d576-4425-8c21-098efec4ae4c) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 430, in _update_volume_swap Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi old_volume = self.volume_api.get(context, old_volume_id) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 34104442-d448-4fbf-9ce6-1eccac542dfb could not be found. Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 522, in update Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self._update_volume_swap(req, instance, id, body) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 432, in _update_volume_swap Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 34104442-d448-4fbf-9ce6-1eccac542dfb could not be found. Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 34104442-d448-4fbf-9ce6-1eccac542dfb could not be found. Apr 14 04:25:22 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:25:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] Returning 404 to user: Volume 34104442-d448-4fbf-9ce6-1eccac542dfb could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:25:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-71fc17ae-3930-4a6e-9de1-3fb74d3b905b tempest-VolumesAdminNegativeTest-1895968812 tempest-VolumesAdminNegativeTest-1895968812-project-admin] 10.0.0.210 "PUT /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55/os-volume_attachments/34104442-d448-4fbf-9ce6-1eccac542dfb" status: 404 len: 109 microversion: 2.1 time: 0.121195 Apr 14 04:25:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 166/501] 10.0.0.210 () {64 vars in 1510 bytes} [Fri Apr 14 04:25:22 2023] PUT /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55/os-volume_attachments/34104442-d448-4fbf-9ce6-1eccac542dfb => generated 109 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:25 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:25:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5eb2850a-dcbe-4623-9f9e-c7cc838657d1 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55" status: 204 len: 0 microversion: 2.1 time: 0.152068 Apr 14 04:25:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 167/502] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:25:25 2023] DELETE /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=28,nova_api:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:25 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2561bbc0c6d447da333ffdbb9fdc5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d389bb78d2e40b9b07d2d3ecdb7566b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-eb3ca71a-5317-46e8-9f4f-19f1725c7456 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55" status: 200 len: 1503 microversion: 2.1 time: 0.314290 Apr 14 04:25:26 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 170/503] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:25 2023] GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 => generated 1503 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:26 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-c3b3e565-9d58-4d08-bcbe-3e4c9eac120a req-372abaa4-6ddd-4c99-8356-83e4f52d54b3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffb8a8e-b24f-46e8-84c4-130e9f18cf55", "name": "network-vif-unplugged", "status": "completed", "tag": "d2a30aa1-7a43-4150-97c4-f312dea34ae7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:26 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=3,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c3b3e565-9d58-4d08-bcbe-3e4c9eac120a req-372abaa4-6ddd-4c99-8356-83e4f52d54b3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c3b3e565-9d58-4d08-bcbe-3e4c9eac120a req-372abaa4-6ddd-4c99-8356-83e4f52d54b3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c3b3e565-9d58-4d08-bcbe-3e4c9eac120a req-372abaa4-6ddd-4c99-8356-83e4f52d54b3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:26 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=60,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:26 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-c3b3e565-9d58-4d08-bcbe-3e4c9eac120a req-372abaa4-6ddd-4c99-8356-83e4f52d54b3 service nova] Creating event network-vif-unplugged:d2a30aa1-7a43-4150-97c4-f312dea34ae7 for instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 on user Apr 14 04:25:26 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-c3b3e565-9d58-4d08-bcbe-3e4c9eac120a req-372abaa4-6ddd-4c99-8356-83e4f52d54b3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039894 Apr 14 04:25:26 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 168/504] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:26 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:26 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3566b497-39a3-41ad-bd38-5a72fa3d3dd3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1675 microversion: 2.1 time: 0.314040 Apr 14 04:25:26 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 167/505] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:25 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1675 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cdf2c58-c295-483e-b766-13e01129ede2"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e14ca792-7652-4305-8e06-f9fe36de7f49 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.336043 Apr 14 04:25:26 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 171/506] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:25:26 2023] POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments => generated 194 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:27 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-8efab41a-4d79-407f-958f-f5a23bc85fe5 req-55d10506-6338-40af-b3df-9749edd562b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffb8a8e-b24f-46e8-84c4-130e9f18cf55", "name": "network-vif-deleted", "tag": "d2a30aa1-7a43-4150-97c4-f312dea34ae7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8efab41a-4d79-407f-958f-f5a23bc85fe5 req-55d10506-6338-40af-b3df-9749edd562b6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8efab41a-4d79-407f-958f-f5a23bc85fe5 req-55d10506-6338-40af-b3df-9749edd562b6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8efab41a-4d79-407f-958f-f5a23bc85fe5 req-55d10506-6338-40af-b3df-9749edd562b6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-8efab41a-4d79-407f-958f-f5a23bc85fe5 req-55d10506-6338-40af-b3df-9749edd562b6 service nova] Creating event network-vif-deleted:d2a30aa1-7a43-4150-97c4-f312dea34ae7 for instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 on user Apr 14 04:25:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-8efab41a-4d79-407f-958f-f5a23bc85fe5 req-55d10506-6338-40af-b3df-9749edd562b6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050315 Apr 14 04:25:27 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 169/507] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:28 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-bdc63560-eaef-4b3e-920a-4afeb81b8a73 req-bd3ab1ad-8aa2-4388-b397-a2a63d69bdc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ffb8a8e-b24f-46e8-84c4-130e9f18cf55", "name": "network-vif-plugged", "status": "completed", "tag": "d2a30aa1-7a43-4150-97c4-f312dea34ae7"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-bdc63560-eaef-4b3e-920a-4afeb81b8a73 req-bd3ab1ad-8aa2-4388-b397-a2a63d69bdc8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-bdc63560-eaef-4b3e-920a-4afeb81b8a73 req-bd3ab1ad-8aa2-4388-b397-a2a63d69bdc8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-bdc63560-eaef-4b3e-920a-4afeb81b8a73 req-bd3ab1ad-8aa2-4388-b397-a2a63d69bdc8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:28 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-bdc63560-eaef-4b3e-920a-4afeb81b8a73 req-bd3ab1ad-8aa2-4388-b397-a2a63d69bdc8 service nova] Creating event network-vif-plugged:d2a30aa1-7a43-4150-97c4-f312dea34ae7 for instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 on user Apr 14 04:25:28 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-bdc63560-eaef-4b3e-920a-4afeb81b8a73 req-bd3ab1ad-8aa2-4388-b397-a2a63d69bdc8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030465 Apr 14 04:25:28 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 168/508] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Old instance type m1.nano, new instance type m1.micro {{(pid=61596) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for user e35b3ae371cf4dd4b21e2999e58cd2f4 and project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:25:34 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-73dfdb1e-0807-432c-bf28-6bfdb163a434 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/action" status: 202 len: 0 microversion: 2.1 time: 0.433955 Apr 14 04:25:34 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 172/509] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:25:34 2023] POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/action => generated 0 bytes in 436 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:34 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3c1b814ec240279646878fd090f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39731dbb51484eff890a74b07241ba75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:34 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2d2a083b-3943-4636-b751-5bdbde2ef5f2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066" status: 200 len: 1567 microversion: 2.1 time: 0.234728 Apr 14 04:25:34 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 170/510] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:34 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066 => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:34 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:34 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f52ba394-36b6-4362-8b58-f601f60d229e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1730 microversion: 2.1 time: 0.267191 Apr 14 04:25:34 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 169/511] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:34 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1730 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] [instance: 46a5fd77-abec-4ab3-b519-7c649e63459c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:35 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] HTTP exception thrown: Instance 46a5fd77-abec-4ab3-b519-7c649e63459c could not be found. Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Request method failure captured: Apr 14 04:25:35 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c HTTP/1.1 Apr 14 04:25:35 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:25:35 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:25:35 user devstack@n-api.service[61596]: Connection: close Apr 14 04:25:35 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:25:35 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:25:35 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:25:35 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:25:35 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONUbrsphbq69vqaxDaS_BSXf5VnZ59g0dYGg8wvSXgxKmVwYEtuOy-1XEr4CNbVRAgSsy_00LGuiuMmQBikhyWn4MeN_y56dD0jZ3XJin4CBD3KwLeZB3NKELpipDeJXnbC6SVnLLvU3ApLxPoCybilWHNk9gReb1N9d4dbc4YkForU Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Project-Id: 3f45f01678f747268221c00f75924c69 Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesNegativeTest-1984420239 Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3f45f01678f747268221c00f75924c69"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f45f01678f747268221c00f75924c69"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3f45f01678f747268221c00f75924c69"}]}] Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesNegativeTest-1984420239 Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Tenant-Id: 3f45f01678f747268221c00f75924c69 Apr 14 04:25:35 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesNegativeTest-1984420239 Apr 14 04:25:35 user devstack@n-api.service[61596]: X-User: tempest-VolumesNegativeTest-1984420239-project-member Apr 14 04:25:35 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:25:35 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:25:35 user devstack@n-api.service[61596]: X-User-Id: 275086d3eec449678b6b5ba6f3f887b2 Apr 14 04:25:35 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesNegativeTest-1984420239-project-member Apr 14 04:25:35 user devstack@n-api.service[61596]: method: > Apr 14 04:25:35 user devstack@n-api.service[61596]: exception: Instance 46a5fd77-abec-4ab3-b519-7c649e63459c could not be found. Apr 14 04:25:35 user devstack@n-api.service[61596]: action_args: {'id': '46a5fd77-abec-4ab3-b519-7c649e63459c'} Apr 14 04:25:35 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46a5fd77-abec-4ab3-b519-7c649e63459c could not be found. Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46a5fd77-abec-4ab3-b519-7c649e63459c could not be found. Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46a5fd77-abec-4ab3-b519-7c649e63459c could not be found. Apr 14 04:25:35 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:35 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] Returning 404 to user: Instance 46a5fd77-abec-4ab3-b519-7c649e63459c could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:25:35 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c215a7d5-899e-4d78-9088-b99b6621efc3 tempest-VolumesNegativeTest-1984420239 tempest-VolumesNegativeTest-1984420239-project-member] 10.0.0.210 "GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c" status: 404 len: 111 microversion: 2.1 time: 0.028998 Apr 14 04:25:35 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 173/512] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:35 2023] GET /compute/v2.1/servers/46a5fd77-abec-4ab3-b519-7c649e63459c => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:25:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-93f59faf-7494-447c-81ae-92cbf60a4161 req-bfdcae2e-97c3-45f3-a101-909b0b5d57c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-93f59faf-7494-447c-81ae-92cbf60a4161 req-bfdcae2e-97c3-45f3-a101-909b0b5d57c0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-93f59faf-7494-447c-81ae-92cbf60a4161 req-bfdcae2e-97c3-45f3-a101-909b0b5d57c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-93f59faf-7494-447c-81ae-92cbf60a4161 req-bfdcae2e-97c3-45f3-a101-909b0b5d57c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:38 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-93f59faf-7494-447c-81ae-92cbf60a4161 req-bfdcae2e-97c3-45f3-a101-909b0b5d57c0 service nova] Creating event network-vif-unplugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:25:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [req-93f59faf-7494-447c-81ae-92cbf60a4161 req-bfdcae2e-97c3-45f3-a101-909b0b5d57c0 service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:25:38 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-93f59faf-7494-447c-81ae-92cbf60a4161 req-bfdcae2e-97c3-45f3-a101-909b0b5d57c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046191 Apr 14 04:25:38 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 171/513] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:39 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-c7d74ffb-ad5e-485c-a485-6a6c16e06ce5 req-9a938db4-ef5c-4836-a40e-9795a252f42b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c7d74ffb-ad5e-485c-a485-6a6c16e06ce5 req-9a938db4-ef5c-4836-a40e-9795a252f42b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c7d74ffb-ad5e-485c-a485-6a6c16e06ce5 req-9a938db4-ef5c-4836-a40e-9795a252f42b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c7d74ffb-ad5e-485c-a485-6a6c16e06ce5 req-9a938db4-ef5c-4836-a40e-9795a252f42b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-c7d74ffb-ad5e-485c-a485-6a6c16e06ce5 req-9a938db4-ef5c-4836-a40e-9795a252f42b service nova] Creating event network-changed:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:25:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-c7d74ffb-ad5e-485c-a485-6a6c16e06ce5 req-9a938db4-ef5c-4836-a40e-9795a252f42b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038388 Apr 14 04:25:39 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 170/514] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:39 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ee7c552-e40e-4341-992f-722c82128913"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1f100ed4-bcb9-4964-abf9-733a0cd9df5c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.356082 Apr 14 04:25:39 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 174/515] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:25:39 2023] POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 194 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-15a6fd4d-ca60-4e17-bd72-84df08646fdf req-333385cf-b594-42a2-9dce-af8dd624cd72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-15a6fd4d-ca60-4e17-bd72-84df08646fdf req-333385cf-b594-42a2-9dce-af8dd624cd72 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-15a6fd4d-ca60-4e17-bd72-84df08646fdf req-333385cf-b594-42a2-9dce-af8dd624cd72 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-15a6fd4d-ca60-4e17-bd72-84df08646fdf req-333385cf-b594-42a2-9dce-af8dd624cd72 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-15a6fd4d-ca60-4e17-bd72-84df08646fdf req-333385cf-b594-42a2-9dce-af8dd624cd72 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:25:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [req-15a6fd4d-ca60-4e17-bd72-84df08646fdf req-333385cf-b594-42a2-9dce-af8dd624cd72 service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:25:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-15a6fd4d-ca60-4e17-bd72-84df08646fdf req-333385cf-b594-42a2-9dce-af8dd624cd72 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039101 Apr 14 04:25:40 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 172/516] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:40 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:41 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ecccf02b-9e33-4592-b6a1-eb1ad20b560b tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1534 microversion: 2.1 time: 0.254854 Apr 14 04:25:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 171/517] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:41 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1534 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Searching by: {'deleted': False, 'project_id': '0a60f60717b44f4ba904a949eabfe608'} {{(pid=61596) get_all /opt/stack/nova/nova/compute/api.py:3019}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=35 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=6,nova_cell1:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:41 user devstack@n-api.service[61596]: DEBUG nova.compute.multi_cell_list [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=61596) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Apr 14 04:25:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3db6c482-83f8-4f76-b44f-bfd743c7457a tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers" status: 200 len: 340 microversion: 2.1 time: 0.192554 Apr 14 04:25:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 175/518] 10.0.0.210 () {62 vars in 1202 bytes} [Fri Apr 14 04:25:41 2023] GET /compute/v2.1/servers => generated 340 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:41 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-34e7e479-d255-4bbe-9b71-d2834c240221 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1534 microversion: 2.1 time: 0.275457 Apr 14 04:25:41 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 173/519] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:41 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1534 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8f57c49-602f-450f-8b9e-69f1f0255cee"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-821f1dd4-d2e1-4816-bea4-392d5e29a118 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284703 Apr 14 04:25:44 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 172/520] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:25:44 2023] POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 97392a47-53f0-4bde-977a-e2945332fe1f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] HTTP exception thrown: Instance 97392a47-53f0-4bde-977a-e2945332fe1f could not be found. Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Request method failure captured: Apr 14 04:25:46 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f HTTP/1.1 Apr 14 04:25:46 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:25:46 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:25:46 user devstack@n-api.service[61596]: Connection: close Apr 14 04:25:46 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:25:46 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:25:46 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:25:46 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:25:46 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONUDZklv-EAByjN7Boe22vvzGu20VIeAeyWgI21qWQHEpMiJJEjxvthc-_2s8vupsC3k6kZrDZY1tHB6pB3nFgcf41dTq3iy3tQKK08FsXR8E1yMjoSnGDpatdcMdTVL7ZqCDc2mG3ckIU-tOV1b2QZx238nlY4yZX9UPZkXg8-HRT4 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Project-Id: 0848c9a67e2746e5b12b73920215b729 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1226436274 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0848c9a67e2746e5b12b73920215b729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0848c9a67e2746e5b12b73920215b729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0848c9a67e2746e5b12b73920215b729"}]}] Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesSnapshotTestJSON-1226436274 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Tenant-Id: 0848c9a67e2746e5b12b73920215b729 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1226436274 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-User: tempest-VolumesSnapshotTestJSON-1226436274-project-member Apr 14 04:25:46 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:25:46 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:25:46 user devstack@n-api.service[61596]: X-User-Id: e4a70281d6734c15b3c4b1b00e4b5d44 Apr 14 04:25:46 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesSnapshotTestJSON-1226436274-project-member Apr 14 04:25:46 user devstack@n-api.service[61596]: method: > Apr 14 04:25:46 user devstack@n-api.service[61596]: exception: Instance 97392a47-53f0-4bde-977a-e2945332fe1f could not be found. Apr 14 04:25:46 user devstack@n-api.service[61596]: action_args: {'id': '97392a47-53f0-4bde-977a-e2945332fe1f'} Apr 14 04:25:46 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 97392a47-53f0-4bde-977a-e2945332fe1f could not be found. Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 97392a47-53f0-4bde-977a-e2945332fe1f could not be found. Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 97392a47-53f0-4bde-977a-e2945332fe1f could not be found. Apr 14 04:25:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:25:46 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Returning 404 to user: Instance 97392a47-53f0-4bde-977a-e2945332fe1f could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:25:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-40cfba8c-a0b9-408b-baec-2a64c6320249 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f" status: 404 len: 111 microversion: 2.1 time: 0.289697 Apr 14 04:25:46 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 176/521] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:46 2023] GET /compute/v2.1/servers/97392a47-53f0-4bde-977a-e2945332fe1f => generated 111 bytes in 291 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:25:51 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-9d17a68d-7d26-4d84-a174-630a5d61e5b5 req-07767c19-d32e-4c0e-963d-f710b7458482 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:51 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-9d17a68d-7d26-4d84-a174-630a5d61e5b5 req-07767c19-d32e-4c0e-963d-f710b7458482 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:51 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-9d17a68d-7d26-4d84-a174-630a5d61e5b5 req-07767c19-d32e-4c0e-963d-f710b7458482 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:51 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-9d17a68d-7d26-4d84-a174-630a5d61e5b5 req-07767c19-d32e-4c0e-963d-f710b7458482 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:51 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-9d17a68d-7d26-4d84-a174-630a5d61e5b5 req-07767c19-d32e-4c0e-963d-f710b7458482 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:25:51 user devstack@n-api.service[61597]: DEBUG nova.compute.api [req-9d17a68d-7d26-4d84-a174-630a5d61e5b5 req-07767c19-d32e-4c0e-963d-f710b7458482 service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:25:51 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-9d17a68d-7d26-4d84-a174-630a5d61e5b5 req-07767c19-d32e-4c0e-963d-f710b7458482 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075459 Apr 14 04:25:51 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 174/522] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-15966f3d-ea09-465f-b8fb-b9ba56ef2e87 req-cfe2dc5e-1356-47b9-8dfd-ddf2a8ccb508 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:53 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=5 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-15966f3d-ea09-465f-b8fb-b9ba56ef2e87 req-cfe2dc5e-1356-47b9-8dfd-ddf2a8ccb508 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-15966f3d-ea09-465f-b8fb-b9ba56ef2e87 req-cfe2dc5e-1356-47b9-8dfd-ddf2a8ccb508 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-15966f3d-ea09-465f-b8fb-b9ba56ef2e87 req-cfe2dc5e-1356-47b9-8dfd-ddf2a8ccb508 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-15966f3d-ea09-465f-b8fb-b9ba56ef2e87 req-cfe2dc5e-1356-47b9-8dfd-ddf2a8ccb508 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:25:53 user devstack@n-api.service[61596]: DEBUG nova.compute.api [req-15966f3d-ea09-465f-b8fb-b9ba56ef2e87 req-cfe2dc5e-1356-47b9-8dfd-ddf2a8ccb508 service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:25:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-15966f3d-ea09-465f-b8fb-b9ba56ef2e87 req-cfe2dc5e-1356-47b9-8dfd-ddf2a8ccb508 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048556 Apr 14 04:25:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 177/523] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:53 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:53 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-aca8b833-4e32-49c5-9910-8a81f53cceed tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1580 microversion: 2.1 time: 0.295868 Apr 14 04:25:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 173/524] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:53 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1580 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:25:55 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f3e9ce33-f9c4-48df-abb8-e3d97456d385 req-17b3db18-7005-4f19-b566-08ba99b97deb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f3e9ce33-f9c4-48df-abb8-e3d97456d385 req-17b3db18-7005-4f19-b566-08ba99b97deb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f3e9ce33-f9c4-48df-abb8-e3d97456d385 req-17b3db18-7005-4f19-b566-08ba99b97deb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f3e9ce33-f9c4-48df-abb8-e3d97456d385 req-17b3db18-7005-4f19-b566-08ba99b97deb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:55 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f3e9ce33-f9c4-48df-abb8-e3d97456d385 req-17b3db18-7005-4f19-b566-08ba99b97deb service nova] Creating event network-changed:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:25:55 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f3e9ce33-f9c4-48df-abb8-e3d97456d385 req-17b3db18-7005-4f19-b566-08ba99b97deb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034801 Apr 14 04:25:55 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 175/525] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:55 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-245510343"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:58 user devstack@n-api.service[61596]: INFO nova.network.security_group_api [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Adding security group 2f0106f8-a6c0-4b20-adb5-25f7a25a0d81 to port dc662cd5-f74a-40ee-bc14-e0948cbc4f36 Apr 14 04:25:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ad10cdaf-f09c-4139-9697-92d06fef8e19 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/action" status: 202 len: 0 microversion: 2.1 time: 0.906470 Apr 14 04:25:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 178/526] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:25:58 2023] POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/action => generated 0 bytes in 909 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=14 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-8f17bb6d-4c90-4111-9424-50e535cd34cc req-41e5af57-cc5f-44de-8e67-8c805219dfa1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=39,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=16 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8f17bb6d-4c90-4111-9424-50e535cd34cc req-41e5af57-cc5f-44de-8e67-8c805219dfa1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8f17bb6d-4c90-4111-9424-50e535cd34cc req-41e5af57-cc5f-44de-8e67-8c805219dfa1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-8f17bb6d-4c90-4111-9424-50e535cd34cc req-41e5af57-cc5f-44de-8e67-8c805219dfa1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=30 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:25:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-8f17bb6d-4c90-4111-9424-50e535cd34cc req-41e5af57-cc5f-44de-8e67-8c805219dfa1 service nova] Creating event network-changed:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:25:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-8f17bb6d-4c90-4111-9424-50e535cd34cc req-41e5af57-cc5f-44de-8e67-8c805219dfa1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046602 Apr 14 04:25:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 176/527] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:25:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:25:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-50241bef-67ff-45ef-8da8-a359a1415b2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1744 microversion: 2.1 time: 0.290543 Apr 14 04:25:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 174/528] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:59 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1744 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3bda85c0-2ee6-49e1-9b97-a7506a3fa0b1 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/action" status: 202 len: 0 microversion: 2.1 time: 0.146467 Apr 14 04:25:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 179/529] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:25:59 2023] POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:25:59 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lazy-loading 'services' on Instance uuid f593ceb0-de44-490b-b365-3a05a3acd066 {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:25:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f46f2647-2e71-425b-b985-cefd73608fd8 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/8ee7c552-e40e-4341-992f-722c82128913" status: 202 len: 0 microversion: 2.1 time: 0.191234 Apr 14 04:25:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 175/530] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:25:59 2023] DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/8ee7c552-e40e-4341-992f-722c82128913 => generated 0 bytes in 193 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-bb3dbef9-583c-4279-8df6-7e719eac388a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091056 Apr 14 04:26:00 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 180/531] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:25:59 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:00 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:00 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-36812b90-f1f6-451d-a1de-f4d19e5c4b64 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1736 microversion: 2.1 time: 0.508460 Apr 14 04:26:00 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 177/532] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:25:59 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1736 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] [instance: 9b532a44-20b7-4590-babe-684c49598a62] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1404624303", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "1a977934-32df-4abc-b8da-83e57587448a", "source_type": "snapshot", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e20e0d94-3b17-4872-b774-3a724d3a253b"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] HTTP exception thrown: Instance 9b532a44-20b7-4590-babe-684c49598a62 could not be found. Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Request method failure captured: Apr 14 04:26:00 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 HTTP/1.1 Apr 14 04:26:00 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:26:00 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:26:00 user devstack@n-api.service[61595]: Connection: close Apr 14 04:26:00 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:26:00 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:26:00 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:26:00 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:26:00 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOWSWL2iiuqjOKVXicFpVq3QynyS329JzabhIMRpTcE4u2nhOOGF_8pA3phEwF4Flx1eAEwXHOb4fAgQReFoofQtjbUxZflJc81TLe9wZ0GQOPZGEM5aHjAJmm_B5CLyBoVmu0QB2gRz5uHILI8GGX6hRONCaH8BhaaF5BW5Tr45I8 Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Project-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/bae0fb4af555422a847620627dffeae8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/bae0fb4af555422a847620627dffeae8"}]}] Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Tenant: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Tenant-Id: bae0fb4af555422a847620627dffeae8 Apr 14 04:26:00 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServersNegativeTestJSON-406789078 Apr 14 04:26:00 user devstack@n-api.service[61595]: X-User: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:26:00 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:26:00 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:26:00 user devstack@n-api.service[61595]: X-User-Id: ea68fb139b004f748cf1bcfb8d675a2e Apr 14 04:26:00 user devstack@n-api.service[61595]: X-User-Name: tempest-ServersNegativeTestJSON-406789078-project-member Apr 14 04:26:00 user devstack@n-api.service[61595]: method: > Apr 14 04:26:00 user devstack@n-api.service[61595]: exception: Instance 9b532a44-20b7-4590-babe-684c49598a62 could not be found. Apr 14 04:26:00 user devstack@n-api.service[61595]: action_args: {'id': '9b532a44-20b7-4590-babe-684c49598a62'} Apr 14 04:26:00 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9b532a44-20b7-4590-babe-684c49598a62 could not be found. Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9b532a44-20b7-4590-babe-684c49598a62 could not be found. Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9b532a44-20b7-4590-babe-684c49598a62 could not be found. Apr 14 04:26:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:26:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] Returning 404 to user: Instance 9b532a44-20b7-4590-babe-684c49598a62 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:26:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3223330e-44b0-4b6f-a205-dfc57dbdcde9 tempest-ServersNegativeTestJSON-406789078 tempest-ServersNegativeTestJSON-406789078-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62" status: 404 len: 111 microversion: 2.1 time: 0.034209 Apr 14 04:26:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 176/533] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:00 2023] GET /compute/v2.1/servers/9b532a44-20b7-4590-babe-684c49598a62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:26:00 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] validate_networks() for [('e20e0d94-3b17-4872-b774-3a724d3a253b', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-693983371", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "21178b4b-c88e-43e2-9154-d5116a59802d"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] validate_networks() for [('21178b4b-c88e-43e2-9154-d5116a59802d', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for user bcf79de7da27495dbfd14c556b5b54c7 and project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:26:01 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='1a977934-32df-4abc-b8da-83e57587448a',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:26:01 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1de54cae-2ff1-44b0-90e1-d06bf788dea6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.977095 Apr 14 04:26:01 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 181/534] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:26:00 2023] POST /compute/v2.1/servers => generated 378 bytes in 979 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:26:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7551e379-1a75-4295-a2ad-d65e8e359800 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7551e379-1a75-4295-a2ad-d65e8e359800 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:01 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-7551e379-1a75-4295-a2ad-d65e8e359800 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7551e379-1a75-4295-a2ad-d65e8e359800 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 200 len: 1052 microversion: 2.1 time: 0.116248 Apr 14 04:26:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 177/535] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:01 2023] GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 1052 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Getting quotas for project 0848c9a67e2746e5b12b73920215b729. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Getting quotas for user e4a70281d6734c15b3c4b1b00e4b5d44 and project 0848c9a67e2746e5b12b73920215b729. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:26:01 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:26:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ef99ae98-bc9c-4308-a992-acf2217cf477 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.887094 Apr 14 04:26:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 178/536] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:26:01 2023] POST /compute/v2.1/servers => generated 378 bytes in 889 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3e6a5e76-2e32-4699-9fc8-c0a2439fa65f tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3e6a5e76-2e32-4699-9fc8-c0a2439fa65f tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-3e6a5e76-2e32-4699-9fc8-c0a2439fa65f tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a70281d6734c15b3c4b1b00e4b5d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848c9a67e2746e5b12b73920215b729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3e6a5e76-2e32-4699-9fc8-c0a2439fa65f tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe" status: 200 len: 1212 microversion: 2.1 time: 0.115167 Apr 14 04:26:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 182/537] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:02 2023] GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe => generated 1212 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b1a0091e-f617-49fd-905e-0dc05068b32e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043973 Apr 14 04:26:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 178/538] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:26:02 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:26:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-563aadfb-098f-429c-a16c-bbf1ffa5f89a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 204 len: 0 microversion: 2.1 time: 0.125683 Apr 14 04:26:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 179/539] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:26:02 2023] DELETE /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:03 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-86683d42-1221-4c68-91e8-54722bdeb44d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 200 len: 1663 microversion: 2.1 time: 0.273096 Apr 14 04:26:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 183/540] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:02 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 1663 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:03 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-909f8be4-22f7-4d94-a299-05c2dc23ebfc req-e23c807c-9e4d-4068-b722-3ef0909bd69d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-unplugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-909f8be4-22f7-4d94-a299-05c2dc23ebfc req-e23c807c-9e4d-4068-b722-3ef0909bd69d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-909f8be4-22f7-4d94-a299-05c2dc23ebfc req-e23c807c-9e4d-4068-b722-3ef0909bd69d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:03 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-909f8be4-22f7-4d94-a299-05c2dc23ebfc req-e23c807c-9e4d-4068-b722-3ef0909bd69d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-909f8be4-22f7-4d94-a299-05c2dc23ebfc req-e23c807c-9e4d-4068-b722-3ef0909bd69d service nova] Creating event network-vif-unplugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:26:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-909f8be4-22f7-4d94-a299-05c2dc23ebfc req-e23c807c-9e4d-4068-b722-3ef0909bd69d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.060572 Apr 14 04:26:04 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 179/541] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:03 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:05 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "0d5722c7-7ae1-44d3-9599-66b2d7769656"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:05 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9a3fb60d-8376-4fbc-af0e-478f7658d288 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 200 len: 1554 microversion: 2.1 time: 0.938684 Apr 14 04:26:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 180/542] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:05 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 1554 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:06 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lazy-loading 'flavor' on Instance uuid 3df97db3-fd6c-4be6-af32-7cde9dbcce75 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:26:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-plugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}, {"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-unplugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}, {"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-plugged", "status": "completed", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-bd24d9cc-953a-4c74-9947-6d96e9c7a839 req-93cbcd9a-e7db-4566-9781-f58226513a27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da3b4651-aaa0-430d-85b8-c15de386d08f", "name": "network-vif-deleted", "tag": "df63af46-27d1-4086-ae2c-39e8bc829bc7"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bd24d9cc-953a-4c74-9947-6d96e9c7a839 req-93cbcd9a-e7db-4566-9781-f58226513a27 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bd24d9cc-953a-4c74-9947-6d96e9c7a839 req-93cbcd9a-e7db-4566-9781-f58226513a27 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bd24d9cc-953a-4c74-9947-6d96e9c7a839 req-93cbcd9a-e7db-4566-9781-f58226513a27 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-bd24d9cc-953a-4c74-9947-6d96e9c7a839 req-93cbcd9a-e7db-4566-9781-f58226513a27 service nova] Creating event network-vif-deleted:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:26:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] Creating event network-vif-plugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:26:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] Creating event network-vif-unplugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:26:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] Creating event network-vif-plugged:df63af46-27d1-4086-ae2c-39e8bc829bc7 for instance da3b4651-aaa0-430d-85b8-c15de386d08f on user Apr 14 04:26:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-bd24d9cc-953a-4c74-9947-6d96e9c7a839 req-93cbcd9a-e7db-4566-9781-f58226513a27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040282 Apr 14 04:26:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 181/543] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-2373ad40-ad64-4421-9d44-40f3c2c98d34 req-d1c6421b-c1a4-45ec-9a47-e6cab56987f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 527 microversion: 2.1 time: 0.064461 Apr 14 04:26:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 180/544] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:06 2023] POST /compute/v2.1/os-server-external-events => generated 527 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2a49fde2-6a50-4f96-92f5-858e02e8f71c tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75/action" status: 200 len: 29 microversion: 2.87 time: 0.858728 Apr 14 04:26:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 184/545] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:26:05 2023] POST /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75/action => generated 29 bytes in 861 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:07 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:07 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:07 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:07 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e76324cf-6b8f-4558-9a34-8666b140822e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 200 len: 1776 microversion: 2.87 time: 0.380234 Apr 14 04:26:07 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 182/546] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:26:06 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 1776 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:26:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-13459c7d-5414-49f5-a790-88941d5f8f3c req-5057d3fb-d4f9-4f98-a8a1-0353ac2965a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a1c695b-2ca4-4652-8fb6-19accdab6ebe", "tag": "260596e7-554d-4e86-b146-fe487c284c83"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-13459c7d-5414-49f5-a790-88941d5f8f3c req-5057d3fb-d4f9-4f98-a8a1-0353ac2965a2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-13459c7d-5414-49f5-a790-88941d5f8f3c req-5057d3fb-d4f9-4f98-a8a1-0353ac2965a2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-13459c7d-5414-49f5-a790-88941d5f8f3c req-5057d3fb-d4f9-4f98-a8a1-0353ac2965a2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-13459c7d-5414-49f5-a790-88941d5f8f3c req-5057d3fb-d4f9-4f98-a8a1-0353ac2965a2 service nova] Creating event network-changed:260596e7-554d-4e86-b146-fe487c284c83 for instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe on user Apr 14 04:26:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-13459c7d-5414-49f5-a790-88941d5f8f3c req-5057d3fb-d4f9-4f98-a8a1-0353ac2965a2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069448 Apr 14 04:26:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 181/547] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6ffd597a-fe12-4d07-bcc3-1336ebeda63d req-bca4fcb9-11af-4f83-a4ea-3f1a8c5fea7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-unplugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6ffd597a-fe12-4d07-bcc3-1336ebeda63d req-bca4fcb9-11af-4f83-a4ea-3f1a8c5fea7d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6ffd597a-fe12-4d07-bcc3-1336ebeda63d req-bca4fcb9-11af-4f83-a4ea-3f1a8c5fea7d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6ffd597a-fe12-4d07-bcc3-1336ebeda63d req-bca4fcb9-11af-4f83-a4ea-3f1a8c5fea7d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6ffd597a-fe12-4d07-bcc3-1336ebeda63d req-bca4fcb9-11af-4f83-a4ea-3f1a8c5fea7d service nova] Creating event network-vif-unplugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:26:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-eba4816f-be78-4405-b976-adad70b496ec req-9f14d6b4-8054-4e71-b2ef-fe0c089ac88e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-plugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}, {"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-plugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6ffd597a-fe12-4d07-bcc3-1336ebeda63d req-bca4fcb9-11af-4f83-a4ea-3f1a8c5fea7d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.051178 Apr 14 04:26:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 185/548] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-eba4816f-be78-4405-b976-adad70b496ec req-9f14d6b4-8054-4e71-b2ef-fe0c089ac88e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-eba4816f-be78-4405-b976-adad70b496ec req-9f14d6b4-8054-4e71-b2ef-fe0c089ac88e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-eba4816f-be78-4405-b976-adad70b496ec req-9f14d6b4-8054-4e71-b2ef-fe0c089ac88e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-eba4816f-be78-4405-b976-adad70b496ec req-9f14d6b4-8054-4e71-b2ef-fe0c089ac88e service nova] Creating event network-vif-plugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:26:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-eba4816f-be78-4405-b976-adad70b496ec req-9f14d6b4-8054-4e71-b2ef-fe0c089ac88e service nova] Creating event network-vif-plugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:26:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-eba4816f-be78-4405-b976-adad70b496ec req-9f14d6b4-8054-4e71-b2ef-fe0c089ac88e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.068328 Apr 14 04:26:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 183/549] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:08 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0721d4e3-5244-48aa-bf26-afccd31a2e76 req-1e265db3-2acb-48b6-a4e6-989edea8b9ed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0721d4e3-5244-48aa-bf26-afccd31a2e76 req-1e265db3-2acb-48b6-a4e6-989edea8b9ed service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0721d4e3-5244-48aa-bf26-afccd31a2e76 req-1e265db3-2acb-48b6-a4e6-989edea8b9ed service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0721d4e3-5244-48aa-bf26-afccd31a2e76 req-1e265db3-2acb-48b6-a4e6-989edea8b9ed service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-388729af-0f92-4631-9f6b-f6ddde126be5 req-69ac0a15-1b3c-416e-bc69-6ac38bf34981 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd", "tag": "8864dbfd-6219-4843-aa68-aea87851f10b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0721d4e3-5244-48aa-bf26-afccd31a2e76 req-1e265db3-2acb-48b6-a4e6-989edea8b9ed service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:26:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-388729af-0f92-4631-9f6b-f6ddde126be5 req-69ac0a15-1b3c-416e-bc69-6ac38bf34981 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-388729af-0f92-4631-9f6b-f6ddde126be5 req-69ac0a15-1b3c-416e-bc69-6ac38bf34981 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-388729af-0f92-4631-9f6b-f6ddde126be5 req-69ac0a15-1b3c-416e-bc69-6ac38bf34981 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0721d4e3-5244-48aa-bf26-afccd31a2e76 req-1e265db3-2acb-48b6-a4e6-989edea8b9ed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047935 Apr 14 04:26:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 182/550] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-388729af-0f92-4631-9f6b-f6ddde126be5 req-69ac0a15-1b3c-416e-bc69-6ac38bf34981 service nova] Creating event network-changed:8864dbfd-6219-4843-aa68-aea87851f10b for instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd on user Apr 14 04:26:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-388729af-0f92-4631-9f6b-f6ddde126be5 req-69ac0a15-1b3c-416e-bc69-6ac38bf34981 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033947 Apr 14 04:26:10 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 186/551] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-2c8e6885-3630-41ce-8b7a-c0cbc292f92c req-cf771cf3-78e2-4217-9c8e-84bf3d6b2106 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1c695b-2ca4-4652-8fb6-19accdab6ebe", "name": "network-vif-plugged", "status": "completed", "tag": "260596e7-554d-4e86-b146-fe487c284c83"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2c8e6885-3630-41ce-8b7a-c0cbc292f92c req-cf771cf3-78e2-4217-9c8e-84bf3d6b2106 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2c8e6885-3630-41ce-8b7a-c0cbc292f92c req-cf771cf3-78e2-4217-9c8e-84bf3d6b2106 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2c8e6885-3630-41ce-8b7a-c0cbc292f92c req-cf771cf3-78e2-4217-9c8e-84bf3d6b2106 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2c8e6885-3630-41ce-8b7a-c0cbc292f92c req-cf771cf3-78e2-4217-9c8e-84bf3d6b2106 service nova] Creating event network-vif-plugged:260596e7-554d-4e86-b146-fe487c284c83 for instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe on user Apr 14 04:26:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-2c8e6885-3630-41ce-8b7a-c0cbc292f92c req-cf771cf3-78e2-4217-9c8e-84bf3d6b2106 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051430 Apr 14 04:26:10 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 184/552] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0ac3dc51-10c4-4358-a554-5eac3817b8aa tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Action: 'create', calling method: .version_select at 0x7f538ad365f0>, body: {"keypair": {"name": "tempest-TestShelveInstance-2060150193", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGk9hQ8wpWxQD87wrkXLIqSgBhES95isERnHNc/wFOMwogmDvk0s+HHEuuYbkzB2pEyv6u9qIhQ2bQkxjPV0WSr048nFyVVwxTOQQiEcmHX8pNahIhzR1Wk0Uv6MFb63A=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:11 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-0ac3dc51-10c4-4358-a554-5eac3817b8aa tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Getting quotas for project b0e15d3d3e0943c4b6bd54abf2de5fee. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:26:11 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-0ac3dc51-10c4-4358-a554-5eac3817b8aa tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Getting quotas for user 36b6981092424de781e8403946f956d3 and project b0e15d3d3e0943c4b6bd54abf2de5fee. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:26:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0ac3dc51-10c4-4358-a554-5eac3817b8aa tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.305641 Apr 14 04:26:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 183/553] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:26:10 2023] POST /compute/v2.1/os-keypairs => generated 397 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-4bba5283-8683-442a-893e-e01345498253 req-ba61e0a2-8fde-4a2b-a669-180144ec7f9d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1c695b-2ca4-4652-8fb6-19accdab6ebe", "name": "network-vif-plugged", "status": "completed", "tag": "260596e7-554d-4e86-b146-fe487c284c83"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4bba5283-8683-442a-893e-e01345498253 req-ba61e0a2-8fde-4a2b-a669-180144ec7f9d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4bba5283-8683-442a-893e-e01345498253 req-ba61e0a2-8fde-4a2b-a669-180144ec7f9d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4bba5283-8683-442a-893e-e01345498253 req-ba61e0a2-8fde-4a2b-a669-180144ec7f9d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:12 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-4bba5283-8683-442a-893e-e01345498253 req-ba61e0a2-8fde-4a2b-a669-180144ec7f9d service nova] Creating event network-vif-plugged:260596e7-554d-4e86-b146-fe487c284c83 for instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe on user Apr 14 04:26:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-4bba5283-8683-442a-893e-e01345498253 req-ba61e0a2-8fde-4a2b-a669-180144ec7f9d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053041 Apr 14 04:26:12 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 187/554] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:26:13 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:13 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:13 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-e8e083af-8fbe-43a9-9537-97da40ac5170 req-b333051a-b339-43d7-810f-dbdb2c03fbe8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e8e083af-8fbe-43a9-9537-97da40ac5170 req-b333051a-b339-43d7-810f-dbdb2c03fbe8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e8e083af-8fbe-43a9-9537-97da40ac5170 req-b333051a-b339-43d7-810f-dbdb2c03fbe8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e8e083af-8fbe-43a9-9537-97da40ac5170 req-b333051a-b339-43d7-810f-dbdb2c03fbe8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-e8e083af-8fbe-43a9-9537-97da40ac5170 req-b333051a-b339-43d7-810f-dbdb2c03fbe8 service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:26:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-e8e083af-8fbe-43a9-9537-97da40ac5170 req-b333051a-b339-43d7-810f-dbdb2c03fbe8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059102 Apr 14 04:26:13 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 185/555] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:15 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-93a5a507-a874-459b-a428-43a6834fcda7 req-8e130252-70f4-4664-b043-973be00814f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-93a5a507-a874-459b-a428-43a6834fcda7 req-8e130252-70f4-4664-b043-973be00814f6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-93a5a507-a874-459b-a428-43a6834fcda7 req-8e130252-70f4-4664-b043-973be00814f6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-93a5a507-a874-459b-a428-43a6834fcda7 req-8e130252-70f4-4664-b043-973be00814f6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:15 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-93a5a507-a874-459b-a428-43a6834fcda7 req-8e130252-70f4-4664-b043-973be00814f6 service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:26:15 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-93a5a507-a874-459b-a428-43a6834fcda7 req-8e130252-70f4-4664-b043-973be00814f6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046609 Apr 14 04:26:15 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 184/556] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] HTTP exception thrown: Instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 could not be found. Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Request method failure captured: Apr 14 04:26:16 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 HTTP/1.1 Apr 14 04:26:16 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:26:16 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:26:16 user devstack@n-api.service[61596]: Connection: close Apr 14 04:26:16 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:26:16 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:26:16 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:26:16 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:26:16 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONSEfchhr4AUZS_EgWzKNOe0zYkIq-bEWLkkMthw-_r3r2QlOGhkUWmruJAjn8dZd6uSYFkV6ci4-xd86urye4lH3EGBP5a8fdOVsK4HmSqS5VtkMPaU7PxbXy6nYKuLsjtK15UrcISbxCy2o0TLezhvVIvxkURLLLroGjTNQWz4L_E Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Project-Id: 3d389bb78d2e40b9b07d2d3ecdb7566b Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesAdminNegativeTest-618964915 Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3d389bb78d2e40b9b07d2d3ecdb7566b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d389bb78d2e40b9b07d2d3ecdb7566b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d389bb78d2e40b9b07d2d3ecdb7566b"}]}] Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesAdminNegativeTest-618964915 Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Tenant-Id: 3d389bb78d2e40b9b07d2d3ecdb7566b Apr 14 04:26:16 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-618964915 Apr 14 04:26:16 user devstack@n-api.service[61596]: X-User: tempest-VolumesAdminNegativeTest-618964915-project-member Apr 14 04:26:16 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:26:16 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:26:16 user devstack@n-api.service[61596]: X-User-Id: d2561bbc0c6d447da333ffdbb9fdc5f4 Apr 14 04:26:16 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesAdminNegativeTest-618964915-project-member Apr 14 04:26:16 user devstack@n-api.service[61596]: method: > Apr 14 04:26:16 user devstack@n-api.service[61596]: exception: Instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 could not be found. Apr 14 04:26:16 user devstack@n-api.service[61596]: action_args: {'id': '7ffb8a8e-b24f-46e8-84c4-130e9f18cf55'} Apr 14 04:26:16 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 could not be found. Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 could not be found. Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 could not be found. Apr 14 04:26:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Returning 404 to user: Instance 7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:26:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b3d6ad9a-4977-4cc9-9f42-288196a659d0 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55" status: 404 len: 111 microversion: 2.1 time: 0.377738 Apr 14 04:26:16 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 188/557] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:16 2023] GET /compute/v2.1/servers/7ffb8a8e-b24f-46e8-84c4-130e9f18cf55 => generated 111 bytes in 379 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:26:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-2065386753", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestShelveInstance-2060150193", "security_groups": [{"name": "tempest-secgroup-smoke-1202977724"}], "networks": [{"uuid": "f844ce92-c1a2-47aa-8c67-fe7fb4dbacc9"}], "block_device_mapping_v2": [{"uuid": "bcb3b184-a10d-482d-8c49-1bee42873be4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] validate_networks() for [('f844ce92-c1a2-47aa-8c67-fe7fb4dbacc9', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Getting quotas for project b0e15d3d3e0943c4b6bd54abf2de5fee. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Getting quotas for user 36b6981092424de781e8403946f956d3 and project b0e15d3d3e0943c4b6bd54abf2de5fee. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:26:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bcb3b184-a10d-482d-8c49-1bee42873be4',volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:26:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-975c9fcd-0b03-4103-afc9-56d439ada8a6 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.184862 Apr 14 04:26:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 186/558] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:26:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 1191 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:26:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-782f1733-c44d-4b1b-9234-2b40e7f84501 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:18 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-782f1733-c44d-4b1b-9234-2b40e7f84501 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:18 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-782f1733-c44d-4b1b-9234-2b40e7f84501 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-782f1733-c44d-4b1b-9234-2b40e7f84501 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1084 microversion: 2.1 time: 0.413852 Apr 14 04:26:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 185/559] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:18 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1084 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:26:19 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-631355a9-c92e-4945-8ab5-475df4314ea9 req-cee7bc26-9350-4dfc-b1b1-9e5e37ac091a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd", "name": "network-vif-plugged", "status": "completed", "tag": "8864dbfd-6219-4843-aa68-aea87851f10b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-631355a9-c92e-4945-8ab5-475df4314ea9 req-cee7bc26-9350-4dfc-b1b1-9e5e37ac091a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-631355a9-c92e-4945-8ab5-475df4314ea9 req-cee7bc26-9350-4dfc-b1b1-9e5e37ac091a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-631355a9-c92e-4945-8ab5-475df4314ea9 req-cee7bc26-9350-4dfc-b1b1-9e5e37ac091a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-631355a9-c92e-4945-8ab5-475df4314ea9 req-cee7bc26-9350-4dfc-b1b1-9e5e37ac091a service nova] Creating event network-vif-plugged:8864dbfd-6219-4843-aa68-aea87851f10b for instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd on user Apr 14 04:26:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-631355a9-c92e-4945-8ab5-475df4314ea9 req-cee7bc26-9350-4dfc-b1b1-9e5e37ac091a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073973 Apr 14 04:26:19 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 189/560] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:19 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:26:20 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-1c5ee616-242f-4b51-a37c-5f4d75d5244b tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38" status: 204 len: 0 microversion: 2.1 time: 0.175229 Apr 14 04:26:20 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 187/561] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:26:19 2023] DELETE /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:20 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd2561bbc0c6d447da333ffdbb9fdc5f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3d389bb78d2e40b9b07d2d3ecdb7566b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:20 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f7fb5f31-79e0-424e-ba00-c8387f41de6a tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38" status: 200 len: 1671 microversion: 2.1 time: 0.492455 Apr 14 04:26:20 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 186/562] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:20 2023] GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38 => generated 1671 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-cd2049eb-81f9-41c5-94fa-2dfdf342f374 req-251e5c83-aba2-4808-bdef-a3ab713831b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e6cf32-080b-47b2-b4db-2b776ba85b38", "name": "network-vif-unplugged", "status": "completed", "tag": "7c8689e1-9c0a-42b6-8cb3-7751f619ba1f"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cd2049eb-81f9-41c5-94fa-2dfdf342f374 req-251e5c83-aba2-4808-bdef-a3ab713831b9 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cd2049eb-81f9-41c5-94fa-2dfdf342f374 req-251e5c83-aba2-4808-bdef-a3ab713831b9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cd2049eb-81f9-41c5-94fa-2dfdf342f374 req-251e5c83-aba2-4808-bdef-a3ab713831b9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-cd2049eb-81f9-41c5-94fa-2dfdf342f374 req-251e5c83-aba2-4808-bdef-a3ab713831b9 service nova] Creating event network-vif-unplugged:7c8689e1-9c0a-42b6-8cb3-7751f619ba1f for instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 on user Apr 14 04:26:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-cd2049eb-81f9-41c5-94fa-2dfdf342f374 req-251e5c83-aba2-4808-bdef-a3ab713831b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.040533 Apr 14 04:26:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 190/563] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:20 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-3821f7e2-7ab7-4ad5-bd73-261584146cae req-7caddcda-3a35-4421-b969-36a97eb3e358 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd", "name": "network-vif-plugged", "status": "completed", "tag": "8864dbfd-6219-4843-aa68-aea87851f10b"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3821f7e2-7ab7-4ad5-bd73-261584146cae req-7caddcda-3a35-4421-b969-36a97eb3e358 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3821f7e2-7ab7-4ad5-bd73-261584146cae req-7caddcda-3a35-4421-b969-36a97eb3e358 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3821f7e2-7ab7-4ad5-bd73-261584146cae req-7caddcda-3a35-4421-b969-36a97eb3e358 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-3821f7e2-7ab7-4ad5-bd73-261584146cae req-7caddcda-3a35-4421-b969-36a97eb3e358 service nova] Creating event network-vif-plugged:8864dbfd-6219-4843-aa68-aea87851f10b for instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd on user Apr 14 04:26:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-3821f7e2-7ab7-4ad5-bd73-261584146cae req-7caddcda-3a35-4421-b969-36a97eb3e358 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064773 Apr 14 04:26:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 188/564] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f32b9271-4fcc-4504-8ae6-dfe55f0ef35d req-3f674fc1-8ebd-410d-8517-e68e6e3e587d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e6cf32-080b-47b2-b4db-2b776ba85b38", "name": "network-vif-deleted", "tag": "7c8689e1-9c0a-42b6-8cb3-7751f619ba1f"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f32b9271-4fcc-4504-8ae6-dfe55f0ef35d req-3f674fc1-8ebd-410d-8517-e68e6e3e587d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f32b9271-4fcc-4504-8ae6-dfe55f0ef35d req-3f674fc1-8ebd-410d-8517-e68e6e3e587d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f32b9271-4fcc-4504-8ae6-dfe55f0ef35d req-3f674fc1-8ebd-410d-8517-e68e6e3e587d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f32b9271-4fcc-4504-8ae6-dfe55f0ef35d req-3f674fc1-8ebd-410d-8517-e68e6e3e587d service nova] Creating event network-vif-deleted:7c8689e1-9c0a-42b6-8cb3-7751f619ba1f for instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 on user Apr 14 04:26:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f32b9271-4fcc-4504-8ae6-dfe55f0ef35d req-3f674fc1-8ebd-410d-8517-e68e6e3e587d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031699 Apr 14 04:26:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 187/565] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:26:23 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-b4e51ae7-0c83-4c05-9910-b29e03cbffd2 req-67ad50ca-1213-4ba5-83cb-7fe2423f53e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2e6cf32-080b-47b2-b4db-2b776ba85b38", "name": "network-vif-plugged", "status": "completed", "tag": "7c8689e1-9c0a-42b6-8cb3-7751f619ba1f"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b4e51ae7-0c83-4c05-9910-b29e03cbffd2 req-67ad50ca-1213-4ba5-83cb-7fe2423f53e1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b4e51ae7-0c83-4c05-9910-b29e03cbffd2 req-67ad50ca-1213-4ba5-83cb-7fe2423f53e1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b4e51ae7-0c83-4c05-9910-b29e03cbffd2 req-67ad50ca-1213-4ba5-83cb-7fe2423f53e1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:23 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-b4e51ae7-0c83-4c05-9910-b29e03cbffd2 req-67ad50ca-1213-4ba5-83cb-7fe2423f53e1 service nova] Creating event network-vif-plugged:7c8689e1-9c0a-42b6-8cb3-7751f619ba1f for instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 on user Apr 14 04:26:23 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-b4e51ae7-0c83-4c05-9910-b29e03cbffd2 req-67ad50ca-1213-4ba5-83cb-7fe2423f53e1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035017 Apr 14 04:26:23 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 191/566] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-ad71c27b-2583-4d09-af94-676637cc0ae3 req-73530237-ce50-4081-b033-ffdd1f48a734 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ad71c27b-2583-4d09-af94-676637cc0ae3 req-73530237-ce50-4081-b033-ffdd1f48a734 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ad71c27b-2583-4d09-af94-676637cc0ae3 req-73530237-ce50-4081-b033-ffdd1f48a734 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ad71c27b-2583-4d09-af94-676637cc0ae3 req-73530237-ce50-4081-b033-ffdd1f48a734 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-ad71c27b-2583-4d09-af94-676637cc0ae3 req-73530237-ce50-4081-b033-ffdd1f48a734 service nova] Creating event network-changed:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:26:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-ad71c27b-2583-4d09-af94-676637cc0ae3 req-73530237-ce50-4081-b033-ffdd1f48a734 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030270 Apr 14 04:26:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 188/567] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:25 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-1d072e0b-d98c-4638-a95d-68f436ec4371 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1729 microversion: 2.1 time: 0.517594 Apr 14 04:26:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 189/568] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:24 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1729 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:26:30 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-4e7f0cca-3efb-423a-8e8e-beeaee699caa req-23230edd-b3f2-40ae-8c49-4d110abba92c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-plugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4e7f0cca-3efb-423a-8e8e-beeaee699caa req-23230edd-b3f2-40ae-8c49-4d110abba92c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4e7f0cca-3efb-423a-8e8e-beeaee699caa req-23230edd-b3f2-40ae-8c49-4d110abba92c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4e7f0cca-3efb-423a-8e8e-beeaee699caa req-23230edd-b3f2-40ae-8c49-4d110abba92c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-4e7f0cca-3efb-423a-8e8e-beeaee699caa req-23230edd-b3f2-40ae-8c49-4d110abba92c service nova] Creating event network-vif-plugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:26:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-4e7f0cca-3efb-423a-8e8e-beeaee699caa req-23230edd-b3f2-40ae-8c49-4d110abba92c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052583 Apr 14 04:26:30 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 192/569] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:32 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=8 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-b7aa4ae1-6c2c-4c3c-a386-266c28220c6a req-60d1df1d-2004-4424-8599-882d992dfa33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-plugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:32 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b7aa4ae1-6c2c-4c3c-a386-266c28220c6a req-60d1df1d-2004-4424-8599-882d992dfa33 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b7aa4ae1-6c2c-4c3c-a386-266c28220c6a req-60d1df1d-2004-4424-8599-882d992dfa33 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b7aa4ae1-6c2c-4c3c-a386-266c28220c6a req-60d1df1d-2004-4424-8599-882d992dfa33 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:32 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=43,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-b7aa4ae1-6c2c-4c3c-a386-266c28220c6a req-60d1df1d-2004-4424-8599-882d992dfa33 service nova] Creating event network-vif-plugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:26:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-b7aa4ae1-6c2c-4c3c-a386-266c28220c6a req-60d1df1d-2004-4424-8599-882d992dfa33 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057506 Apr 14 04:26:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 189/570] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:50 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e9c5c289-8b25-4bfd-ad29-3ec74649f85f tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054665 Apr 14 04:26:50 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 190/571] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:26:50 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=11 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=11 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:50 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-93cbb746-c2c0-4408-9de5-50c418a4d1e8 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1744 microversion: 2.1 time: 0.279482 Apr 14 04:26:50 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 193/572] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:50 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1744 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:51 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:26:51 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:51 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:51 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:51 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:52 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d9656e71-a340-4a03-bd92-ad2f799ded31 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 200 len: 1379 microversion: 2.1 time: 0.164223 Apr 14 04:26:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 190/573] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:51 2023] GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 1379 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:52 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a70281d6734c15b3c4b1b00e4b5d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848c9a67e2746e5b12b73920215b729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-74fa26a0-a183-4412-b19d-594fb457bf00 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe" status: 200 len: 1495 microversion: 2.1 time: 0.151209 Apr 14 04:26:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 191/574] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:52 2023] GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe => generated 1495 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] HTTP exception thrown: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Request method failure captured: Apr 14 04:26:53 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f HTTP/1.1 Apr 14 04:26:53 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:26:53 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:26:53 user devstack@n-api.service[61596]: Connection: close Apr 14 04:26:53 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:26:53 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:26:53 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:26:53 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:26:53 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOTubSjS5sIi3UL6E5TriLq9NWbcmbuKm2raUB3B9qm_DE8CfpRViYopxyH8fKXF8iKiWpis3b6dDPeKXx1vk-HE1xeBzJ3yt7Ns5cWILoPo382d9B4AKsPZ6uwTqIMEwSUPCULrVI2XEHHUc5D93cBVWFt7dlei6Hqzwr-e8O-aYY Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Project-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}] Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Tenant-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:26:53 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:26:53 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:26:53 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:26:53 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:26:53 user devstack@n-api.service[61596]: X-User-Id: 7610b45003e34f3395268977612f6c94 Apr 14 04:26:53 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:26:53 user devstack@n-api.service[61596]: method: > Apr 14 04:26:53 user devstack@n-api.service[61596]: exception: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:26:53 user devstack@n-api.service[61596]: action_args: {'id': 'da3b4651-aaa0-430d-85b8-c15de386d08f'} Apr 14 04:26:53 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:26:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Returning 404 to user: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:26:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ca16c4ad-2562-43d9-b165-d45a85ba8dfe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 404 len: 111 microversion: 2.1 time: 0.029116 Apr 14 04:26:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 194/575] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:53 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:26:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-9b0cd9f6-ffe0-432d-ae02-1c8e92ed5121 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '.version_select at 0x7f538ad35990>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-9b0cd9f6-ffe0-432d-ae02-1c8e92ed5121 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428467741" status: 202 len: 0 microversion: 2.1 time: 0.023641 Apr 14 04:26:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 191/576] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:26:53 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1428467741 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:26:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-13c9f4d5-fbd1-44a9-84b4-ac87008f8f59 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'create', calling method: .version_select at 0x7f538af82290>, body: {"keypair": {"name": "tempest-keypair-1690869240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPahbjwxSvxq0IxMz5/M3Sbn33mEC8YBDkFVpCOH/WAboRbjSbxsllitzmJB7SVS4TKY3MCm6q57KW3T5WFQQOYggXTJylYDmiHUt2/y+RsASQ2RPX3ud6TI2ErXR0uk4g=="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:53 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-13c9f4d5-fbd1-44a9-84b4-ac87008f8f59 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for project 6a89255339f74e55ad7c92967558bb81. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:26:53 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-13c9f4d5-fbd1-44a9-84b4-ac87008f8f59 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for user 7610b45003e34f3395268977612f6c94 and project 6a89255339f74e55ad7c92967558bb81. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:26:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-13c9f4d5-fbd1-44a9-84b4-ac87008f8f59 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.057240 Apr 14 04:26:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 192/577] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:26:53 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430bf7a7-6067-4516-9a60-f895bded451d"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c9e54616-7ddf-4509-ae7c-9cb334e34657 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305185 Apr 14 04:26:54 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 195/578] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:26:53 2023] POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 194 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:26:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1852573542", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f3cc5345-2e8a-458b-9670-1a780db6a37c"}], "security_groups": [{"name": "tempest-securitygroup--87996663"}], "key_name": "tempest-keypair-1690869240", "user_data": "}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:55 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] validate_networks() for [('f3cc5345-2e8a-458b-9670-1a780db6a37c', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for project 6a89255339f74e55ad7c92967558bb81. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Getting quotas for user 7610b45003e34f3395268977612f6c94 and project 6a89255339f74e55ad7c92967558bb81. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:26:56 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:26:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-054e212a-d99b-48dc-b578-b949add9b0f3 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 398 microversion: 2.1 time: 0.575326 Apr 14 04:26:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 192/579] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:26:55 2023] POST /compute/v2.1/servers => generated 398 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:26:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-52e44d30-df15-4bd6-9a66-75e5007bb6de tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:56 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-52e44d30-df15-4bd6-9a66-75e5007bb6de tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:56 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-52e44d30-df15-4bd6-9a66-75e5007bb6de tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-52e44d30-df15-4bd6-9a66-75e5007bb6de tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de" status: 200 len: 1232 microversion: 2.1 time: 0.082178 Apr 14 04:26:56 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 193/580] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:26:56 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de => generated 1232 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:57 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:26:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f53632ef-6ad3-4a39-964d-42bc01b1bedc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 200 len: 1756 microversion: 2.87 time: 0.421351 Apr 14 04:26:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 196/581] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:26:57 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 1756 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:26:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-456ecbd1-5e8c-4aa5-8e23-62f208e174f4 req-ecff8947-5518-41fe-9392-cbcab6490f58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19eb131-ae90-4220-9d47-15e8b8b332de", "tag": "fab305ad-6649-4e13-944b-82a2dbc76547"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:26:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-456ecbd1-5e8c-4aa5-8e23-62f208e174f4 req-ecff8947-5518-41fe-9392-cbcab6490f58 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:26:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-456ecbd1-5e8c-4aa5-8e23-62f208e174f4 req-ecff8947-5518-41fe-9392-cbcab6490f58 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:26:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-456ecbd1-5e8c-4aa5-8e23-62f208e174f4 req-ecff8947-5518-41fe-9392-cbcab6490f58 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:26:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-456ecbd1-5e8c-4aa5-8e23-62f208e174f4 req-ecff8947-5518-41fe-9392-cbcab6490f58 service nova] Creating event network-changed:fab305ad-6649-4e13-944b-82a2dbc76547 for instance e19eb131-ae90-4220-9d47-15e8b8b332de on user Apr 14 04:26:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-456ecbd1-5e8c-4aa5-8e23-62f208e174f4 req-ecff8947-5518-41fe-9392-cbcab6490f58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087262 Apr 14 04:26:58 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 193/582] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:26:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:01 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-c06f3d60-9ef0-46e3-9bd1-5c349e8a59f4 req-0c5e1f8c-ca46-4dae-ab7a-57ac86a6d240 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19eb131-ae90-4220-9d47-15e8b8b332de", "name": "network-vif-plugged", "status": "completed", "tag": "fab305ad-6649-4e13-944b-82a2dbc76547"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c06f3d60-9ef0-46e3-9bd1-5c349e8a59f4 req-0c5e1f8c-ca46-4dae-ab7a-57ac86a6d240 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c06f3d60-9ef0-46e3-9bd1-5c349e8a59f4 req-0c5e1f8c-ca46-4dae-ab7a-57ac86a6d240 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c06f3d60-9ef0-46e3-9bd1-5c349e8a59f4 req-0c5e1f8c-ca46-4dae-ab7a-57ac86a6d240 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:01 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-c06f3d60-9ef0-46e3-9bd1-5c349e8a59f4 req-0c5e1f8c-ca46-4dae-ab7a-57ac86a6d240 service nova] Creating event network-vif-plugged:fab305ad-6649-4e13-944b-82a2dbc76547 for instance e19eb131-ae90-4220-9d47-15e8b8b332de on user Apr 14 04:27:01 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-c06f3d60-9ef0-46e3-9bd1-5c349e8a59f4 req-0c5e1f8c-ca46-4dae-ab7a-57ac86a6d240 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033930 Apr 14 04:27:01 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 194/583] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:02 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lazy-loading 'services' on Instance uuid f593ceb0-de44-490b-b365-3a05a3acd066 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:27:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-0cb06385-90ad-41ad-b17a-e3dee2a96e6c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/430bf7a7-6067-4516-9a60-f895bded451d" status: 202 len: 0 microversion: 2.1 time: 0.166205 Apr 14 04:27:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 197/584] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:27:02 2023] DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/430bf7a7-6067-4516-9a60-f895bded451d => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f272faf1-2ecc-4741-8249-6c50833cf1e6 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047293 Apr 14 04:27:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 194/585] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:27:02 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:03 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-b4902f2c-3bb0-4fbb-accb-76bbedc5dbb7 req-04d439b5-024d-4321-996a-9a98b7e044bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19eb131-ae90-4220-9d47-15e8b8b332de", "name": "network-vif-plugged", "status": "completed", "tag": "fab305ad-6649-4e13-944b-82a2dbc76547"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b4902f2c-3bb0-4fbb-accb-76bbedc5dbb7 req-04d439b5-024d-4321-996a-9a98b7e044bc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b4902f2c-3bb0-4fbb-accb-76bbedc5dbb7 req-04d439b5-024d-4321-996a-9a98b7e044bc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-b4902f2c-3bb0-4fbb-accb-76bbedc5dbb7 req-04d439b5-024d-4321-996a-9a98b7e044bc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:03 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-b4902f2c-3bb0-4fbb-accb-76bbedc5dbb7 req-04d439b5-024d-4321-996a-9a98b7e044bc service nova] Creating event network-vif-plugged:fab305ad-6649-4e13-944b-82a2dbc76547 for instance e19eb131-ae90-4220-9d47-15e8b8b332de on user Apr 14 04:27:03 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-b4902f2c-3bb0-4fbb-accb-76bbedc5dbb7 req-04d439b5-024d-4321-996a-9a98b7e044bc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030323 Apr 14 04:27:03 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 195/586] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1c471bb9-9fbd-4c55-aae8-232f52d01c0e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.096045 Apr 14 04:27:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 198/587] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:27:06 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-interface => generated 283 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:07 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:07 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-ed93efce-db17-46d5-b1bb-ee2767e07b06 req-fdc5e096-caff-4891-b2a7-0e49089ff91f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ea04249-09da-471f-a8b5-89a901381329"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ed93efce-db17-46d5-b1bb-ee2767e07b06 req-fdc5e096-caff-4891-b2a7-0e49089ff91f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ed93efce-db17-46d5-b1bb-ee2767e07b06 req-fdc5e096-caff-4891-b2a7-0e49089ff91f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ed93efce-db17-46d5-b1bb-ee2767e07b06 req-fdc5e096-caff-4891-b2a7-0e49089ff91f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-ed93efce-db17-46d5-b1bb-ee2767e07b06 req-fdc5e096-caff-4891-b2a7-0e49089ff91f service nova] Creating event network-changed:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:27:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-ed93efce-db17-46d5-b1bb-ee2767e07b06 req-fdc5e096-caff-4891-b2a7-0e49089ff91f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089845 Apr 14 04:27:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 195/588] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:07 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4fe9b03b-4129-4eef-b04c-80c3b2c2300b tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.276861 Apr 14 04:27:07 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 196/589] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:27:07 2023] POST /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments => generated 194 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:08 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-dbb5c32a-1226-4e0f-97c5-ee156a651355 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1435 microversion: 2.1 time: 0.182874 Apr 14 04:27:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 199/590] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:08 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1435 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] [instance: d2e6cf32-080b-47b2-b4db-2b776ba85b38] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] HTTP exception thrown: Instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 could not be found. Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Request method failure captured: Apr 14 04:27:10 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38 HTTP/1.1 Apr 14 04:27:10 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:27:10 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:27:10 user devstack@n-api.service[61595]: Connection: close Apr 14 04:27:10 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:27:10 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:27:10 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:27:10 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:27:10 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONSEfchhr4AUZS_EgWzKNOe0zYkIq-bEWLkkMthw-_r3r2QlOGhkUWmruJAjn8dZd6uSYFkV6ci4-xd86urye4lH3EGBP5a8fdOVsK4HmSqS5VtkMPaU7PxbXy6nYKuLsjtK15UrcISbxCy2o0TLezhvVIvxkURLLLroGjTNQWz4L_E Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Project-Id: 3d389bb78d2e40b9b07d2d3ecdb7566b Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesAdminNegativeTest-618964915 Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3d389bb78d2e40b9b07d2d3ecdb7566b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d389bb78d2e40b9b07d2d3ecdb7566b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3d389bb78d2e40b9b07d2d3ecdb7566b"}]}] Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesAdminNegativeTest-618964915 Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Tenant-Id: 3d389bb78d2e40b9b07d2d3ecdb7566b Apr 14 04:27:10 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesAdminNegativeTest-618964915 Apr 14 04:27:10 user devstack@n-api.service[61595]: X-User: tempest-VolumesAdminNegativeTest-618964915-project-member Apr 14 04:27:10 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:27:10 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:27:10 user devstack@n-api.service[61595]: X-User-Id: d2561bbc0c6d447da333ffdbb9fdc5f4 Apr 14 04:27:10 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesAdminNegativeTest-618964915-project-member Apr 14 04:27:10 user devstack@n-api.service[61595]: method: > Apr 14 04:27:10 user devstack@n-api.service[61595]: exception: Instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 could not be found. Apr 14 04:27:10 user devstack@n-api.service[61595]: action_args: {'id': 'd2e6cf32-080b-47b2-b4db-2b776ba85b38'} Apr 14 04:27:10 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 could not be found. Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 could not be found. Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 could not be found. Apr 14 04:27:10 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:27:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Returning 404 to user: Instance d2e6cf32-080b-47b2-b4db-2b776ba85b38 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:27:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-13ce5959-e857-4ac2-9af5-d091406d171d tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38" status: 404 len: 111 microversion: 2.1 time: 0.031164 Apr 14 04:27:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 196/591] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:10 2023] GET /compute/v2.1/servers/d2e6cf32-080b-47b2-b4db-2b776ba85b38 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:27:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2c904e8a-703b-4d8b-b023-593466a95df5 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] Calling method '.version_select at 0x7f538acb4160>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2c904e8a-703b-4d8b-b023-593466a95df5 tempest-VolumesAdminNegativeTest-618964915 tempest-VolumesAdminNegativeTest-618964915-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913633949" status: 202 len: 0 microversion: 2.1 time: 0.024005 Apr 14 04:27:10 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 197/592] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:27:10 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1913633949 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:15 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lazy-loading 'flavor' on Instance uuid cab84e5c-99ba-4e61-bf68-0a02b31ded5c {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:27:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-91e87e29-15fc-4275-8cf3-e205b74f56de tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/action" status: 200 len: 32 microversion: 2.1 time: 0.185834 Apr 14 04:27:15 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 200/593] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:27:15 2023] POST /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/action => generated 32 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:15 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:15 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7c0ea127-2675-4fa1-8fcc-d6a3f6112fdd tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 200 len: 1724 microversion: 2.1 time: 0.275305 Apr 14 04:27:15 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 197/594] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:15 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 1724 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:27:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-093bf229-6fec-425c-a49e-41f2dd2fa49a req-8e1415c5-5e99-4753-a85d-86821c4c0c97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-unplugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-093bf229-6fec-425c-a49e-41f2dd2fa49a req-8e1415c5-5e99-4753-a85d-86821c4c0c97 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-093bf229-6fec-425c-a49e-41f2dd2fa49a req-8e1415c5-5e99-4753-a85d-86821c4c0c97 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-093bf229-6fec-425c-a49e-41f2dd2fa49a req-8e1415c5-5e99-4753-a85d-86821c4c0c97 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-093bf229-6fec-425c-a49e-41f2dd2fa49a req-8e1415c5-5e99-4753-a85d-86821c4c0c97 service nova] Creating event network-vif-unplugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:27:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-093bf229-6fec-425c-a49e-41f2dd2fa49a req-8e1415c5-5e99-4753-a85d-86821c4c0c97 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.087564 Apr 14 04:27:16 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 198/595] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-f3d3e995-8666-4d8a-a2b4-4303b90cd7ed req-4b44ad71-6848-4b74-ac4a-771b5faac4df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f3d3e995-8666-4d8a-a2b4-4303b90cd7ed req-4b44ad71-6848-4b74-ac4a-771b5faac4df service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f3d3e995-8666-4d8a-a2b4-4303b90cd7ed req-4b44ad71-6848-4b74-ac4a-771b5faac4df service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:18 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f3d3e995-8666-4d8a-a2b4-4303b90cd7ed req-4b44ad71-6848-4b74-ac4a-771b5faac4df service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-f3d3e995-8666-4d8a-a2b4-4303b90cd7ed req-4b44ad71-6848-4b74-ac4a-771b5faac4df service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:27:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-f3d3e995-8666-4d8a-a2b4-4303b90cd7ed req-4b44ad71-6848-4b74-ac4a-771b5faac4df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033370 Apr 14 04:27:18 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 201/596] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:20 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-ef392c46-9008-415f-9d40-91829e7299b8 req-ab4d01cd-94ae-42cb-a51a-27e0de20fc4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}, {"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ef392c46-9008-415f-9d40-91829e7299b8 req-ab4d01cd-94ae-42cb-a51a-27e0de20fc4f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ef392c46-9008-415f-9d40-91829e7299b8 req-ab4d01cd-94ae-42cb-a51a-27e0de20fc4f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ef392c46-9008-415f-9d40-91829e7299b8 req-ab4d01cd-94ae-42cb-a51a-27e0de20fc4f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:20 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-ef392c46-9008-415f-9d40-91829e7299b8 req-ab4d01cd-94ae-42cb-a51a-27e0de20fc4f service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:27:20 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-ef392c46-9008-415f-9d40-91829e7299b8 req-ab4d01cd-94ae-42cb-a51a-27e0de20fc4f service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:27:20 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-ef392c46-9008-415f-9d40-91829e7299b8 req-ab4d01cd-94ae-42cb-a51a-27e0de20fc4f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033306 Apr 14 04:27:20 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 198/597] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:20 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'action', calling method: >, body: {"revertResize": {}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:25 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-10ed2ee9-f91e-46e5-8c41-69ca39ca38da tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/action" status: 202 len: 0 microversion: 2.1 time: 0.375475 Apr 14 04:27:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 199/598] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:27:25 2023] POST /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/action => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=21 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:25 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=62,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:26 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a2c3f2b9-522e-46fd-beb4-9b7c6d933fa3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1728 microversion: 2.1 time: 0.250060 Apr 14 04:27:26 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 202/599] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:25 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1728 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:27:27 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-97c65b20-f26d-4b9a-a71f-785198e256b3 req-eae516cc-cff7-4102-b895-6574e2686c83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:27 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-97c65b20-f26d-4b9a-a71f-785198e256b3 req-eae516cc-cff7-4102-b895-6574e2686c83 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-97c65b20-f26d-4b9a-a71f-785198e256b3 req-eae516cc-cff7-4102-b895-6574e2686c83 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:27 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-97c65b20-f26d-4b9a-a71f-785198e256b3 req-eae516cc-cff7-4102-b895-6574e2686c83 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:27 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=30 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:27 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-97c65b20-f26d-4b9a-a71f-785198e256b3 req-eae516cc-cff7-4102-b895-6574e2686c83 service nova] Creating event network-vif-unplugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:27:27 user devstack@n-api.service[61595]: DEBUG nova.compute.api [req-97c65b20-f26d-4b9a-a71f-785198e256b3 req-eae516cc-cff7-4102-b895-6574e2686c83 service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:27:27 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-97c65b20-f26d-4b9a-a71f-785198e256b3 req-eae516cc-cff7-4102-b895-6574e2686c83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.066389 Apr 14 04:27:27 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 199/600] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:27 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:29 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-584d0eec-608f-4d31-aed1-7daec5ab3149 req-f4cbd38c-9db7-4a8c-bf57-ba273518e55a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-584d0eec-608f-4d31-aed1-7daec5ab3149 req-f4cbd38c-9db7-4a8c-bf57-ba273518e55a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-584d0eec-608f-4d31-aed1-7daec5ab3149 req-f4cbd38c-9db7-4a8c-bf57-ba273518e55a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:29 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-584d0eec-608f-4d31-aed1-7daec5ab3149 req-f4cbd38c-9db7-4a8c-bf57-ba273518e55a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-584d0eec-608f-4d31-aed1-7daec5ab3149 req-f4cbd38c-9db7-4a8c-bf57-ba273518e55a service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:27:29 user devstack@n-api.service[61597]: DEBUG nova.compute.api [req-584d0eec-608f-4d31-aed1-7daec5ab3149 req-f4cbd38c-9db7-4a8c-bf57-ba273518e55a service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:27:29 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-584d0eec-608f-4d31-aed1-7daec5ab3149 req-f4cbd38c-9db7-4a8c-bf57-ba273518e55a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049212 Apr 14 04:27:29 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 200/601] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-e698e99c-11b7-45f4-8d8d-e339c567fb43 req-d27e0c0a-5fc1-4893-b392-1e53e8b8e104 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=5 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-e698e99c-11b7-45f4-8d8d-e339c567fb43 req-d27e0c0a-5fc1-4893-b392-1e53e8b8e104 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-e698e99c-11b7-45f4-8d8d-e339c567fb43 req-d27e0c0a-5fc1-4893-b392-1e53e8b8e104 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-e698e99c-11b7-45f4-8d8d-e339c567fb43 req-d27e0c0a-5fc1-4893-b392-1e53e8b8e104 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-e698e99c-11b7-45f4-8d8d-e339c567fb43 req-d27e0c0a-5fc1-4893-b392-1e53e8b8e104 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:27:39 user devstack@n-api.service[61596]: DEBUG nova.compute.api [req-e698e99c-11b7-45f4-8d8d-e339c567fb43 req-d27e0c0a-5fc1-4893-b392-1e53e8b8e104 service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:27:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-e698e99c-11b7-45f4-8d8d-e339c567fb43 req-d27e0c0a-5fc1-4893-b392-1e53e8b8e104 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045971 Apr 14 04:27:39 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 203/602] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:39 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:27:41 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:41 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:41 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-9e161a0b-31ae-4137-a88d-2fe874c000d1 req-d64f7c89-1792-46bd-82f9-9be262891b43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9e161a0b-31ae-4137-a88d-2fe874c000d1 req-d64f7c89-1792-46bd-82f9-9be262891b43 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9e161a0b-31ae-4137-a88d-2fe874c000d1 req-d64f7c89-1792-46bd-82f9-9be262891b43 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9e161a0b-31ae-4137-a88d-2fe874c000d1 req-d64f7c89-1792-46bd-82f9-9be262891b43 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-9e161a0b-31ae-4137-a88d-2fe874c000d1 req-d64f7c89-1792-46bd-82f9-9be262891b43 service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:27:41 user devstack@n-api.service[61595]: DEBUG nova.compute.api [req-9e161a0b-31ae-4137-a88d-2fe874c000d1 req-d64f7c89-1792-46bd-82f9-9be262891b43 service nova] Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:27:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-9e161a0b-31ae-4137-a88d-2fe874c000d1 req-d64f7c89-1792-46bd-82f9-9be262891b43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040053 Apr 14 04:27:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 200/603] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:41 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:46 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-c376df78-ddec-45cf-9a4d-55a21ce3fd38 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de" status: 200 len: 1535 microversion: 2.1 time: 0.516605 Apr 14 04:27:46 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 201/604] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:46 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de => generated 1535 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-245510343"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:50 user devstack@n-api.service[61596]: INFO nova.network.security_group_api [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Removing security group 2f0106f8-a6c0-4b20-adb5-25f7a25a0d81 from port dc662cd5-f74a-40ee-bc14-e0948cbc4f36 Apr 14 04:27:51 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-18a60a1e-4fbe-4bf2-9624-d1814e66e6ca tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/action" status: 202 len: 0 microversion: 2.1 time: 0.642036 Apr 14 04:27:51 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 204/605] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:27:50 2023] POST /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/action => generated 0 bytes in 644 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:27:51 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-d573bb18-7dac-4b06-8c6a-b092ce20a414 req-cdc634ce-fa98-4283-bde8-1d46d15ea7e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:51 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-d573bb18-7dac-4b06-8c6a-b092ce20a414 req-cdc634ce-fa98-4283-bde8-1d46d15ea7e8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:51 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-d573bb18-7dac-4b06-8c6a-b092ce20a414 req-cdc634ce-fa98-4283-bde8-1d46d15ea7e8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:51 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-d573bb18-7dac-4b06-8c6a-b092ce20a414 req-cdc634ce-fa98-4283-bde8-1d46d15ea7e8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:51 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-d573bb18-7dac-4b06-8c6a-b092ce20a414 req-cdc634ce-fa98-4283-bde8-1d46d15ea7e8 service nova] Creating event network-changed:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:27:51 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-d573bb18-7dac-4b06-8c6a-b092ce20a414 req-cdc634ce-fa98-4283-bde8-1d46d15ea7e8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033107 Apr 14 04:27:51 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 201/606] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ea33354f-6cb5-41b9-86cf-8ed2a9cdab76 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 200 len: 1379 microversion: 2.1 time: 0.228411 Apr 14 04:27:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 202/607] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:52 2023] GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 1379 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3c0c9dfe-f0b1-412c-8aba-f1602c2fd7c0 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042057 Apr 14 04:27:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 203/608] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:27:52 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9113785-28aa-46da-ae7d-d2f2e9a011b2", "device": "/dev/vdb"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ef5f379e-b7e6-4f4c-b73a-00c431daa984 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "POST /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.598571 Apr 14 04:27:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 202/609] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:27:52 2023] POST /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe/os-volume_attachments => generated 194 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-21169833-063d-49e4-b025-e62206d9a079 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 200 len: 1379 microversion: 2.1 time: 0.739457 Apr 14 04:27:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 205/610] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:52 2023] GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 1379 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:27:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-c7c48dc7-3212-4b47-9372-14dd06b974f2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 204 len: 0 microversion: 2.1 time: 0.141740 Apr 14 04:27:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 204/611] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:27:53 2023] DELETE /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-3854aeb0-dfb4-45c4-8884-4e1441ab203f req-b4df2e95-8a55-44f2-adea-0eb424bfd138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3854aeb0-dfb4-45c4-8884-4e1441ab203f req-b4df2e95-8a55-44f2-adea-0eb424bfd138 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3854aeb0-dfb4-45c4-8884-4e1441ab203f req-b4df2e95-8a55-44f2-adea-0eb424bfd138 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3854aeb0-dfb4-45c4-8884-4e1441ab203f req-b4df2e95-8a55-44f2-adea-0eb424bfd138 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-3854aeb0-dfb4-45c4-8884-4e1441ab203f req-b4df2e95-8a55-44f2-adea-0eb424bfd138 service nova] Creating event network-changed:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:27:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-3854aeb0-dfb4-45c4-8884-4e1441ab203f req-b4df2e95-8a55-44f2-adea-0eb424bfd138 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039167 Apr 14 04:27:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 205/612] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:53 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lazy-loading 'services' on Instance uuid 5273d202-ffc5-43c6-bb4f-f6d1a6855271 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:27:53 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-70e99be1-1ddc-4c64-9b11-41558f762b97 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 200 len: 1385 microversion: 2.1 time: 0.343542 Apr 14 04:27:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 203/613] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:27:53 2023] GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 1385 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:27:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-34f8a0d2-9f1d-4f63-b4f0-94db8b4ed107 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments/d8f57c49-602f-450f-8b9e-69f1f0255cee" status: 202 len: 0 microversion: 2.1 time: 0.272146 Apr 14 04:27:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 206/614] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:27:53 2023] DELETE /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments/d8f57c49-602f-450f-8b9e-69f1f0255cee => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-80a1f305-c56d-4413-a6cd-d81fac2a9029 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049313 Apr 14 04:27:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 206/615] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:27:53 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f7325040-7b11-48be-b3fc-a7fb76a17af3 req-9539ddda-dfe5-4b9a-91c8-ad500fe44c2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd", "name": "network-vif-unplugged", "status": "completed", "tag": "8864dbfd-6219-4843-aa68-aea87851f10b"}, {"server_uuid": "aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd", "name": "network-vif-plugged", "status": "completed", "tag": "8864dbfd-6219-4843-aa68-aea87851f10b"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f7325040-7b11-48be-b3fc-a7fb76a17af3 req-9539ddda-dfe5-4b9a-91c8-ad500fe44c2c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f7325040-7b11-48be-b3fc-a7fb76a17af3 req-9539ddda-dfe5-4b9a-91c8-ad500fe44c2c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f7325040-7b11-48be-b3fc-a7fb76a17af3 req-9539ddda-dfe5-4b9a-91c8-ad500fe44c2c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f7325040-7b11-48be-b3fc-a7fb76a17af3 req-9539ddda-dfe5-4b9a-91c8-ad500fe44c2c service nova] Creating event network-vif-unplugged:8864dbfd-6219-4843-aa68-aea87851f10b for instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd on user Apr 14 04:27:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f7325040-7b11-48be-b3fc-a7fb76a17af3 req-9539ddda-dfe5-4b9a-91c8-ad500fe44c2c service nova] Creating event network-vif-plugged:8864dbfd-6219-4843-aa68-aea87851f10b for instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd on user Apr 14 04:27:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f7325040-7b11-48be-b3fc-a7fb76a17af3 req-9539ddda-dfe5-4b9a-91c8-ad500fe44c2c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.045354 Apr 14 04:27:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 204/616] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:55 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-9937cd1d-b599-4459-a121-36d2a6292ea9 req-47948fd9-aa85-41a7-988d-30bb8cce6e6e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd", "name": "network-vif-deleted", "tag": "8864dbfd-6219-4843-aa68-aea87851f10b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9937cd1d-b599-4459-a121-36d2a6292ea9 req-47948fd9-aa85-41a7-988d-30bb8cce6e6e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9937cd1d-b599-4459-a121-36d2a6292ea9 req-47948fd9-aa85-41a7-988d-30bb8cce6e6e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-9937cd1d-b599-4459-a121-36d2a6292ea9 req-47948fd9-aa85-41a7-988d-30bb8cce6e6e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-9937cd1d-b599-4459-a121-36d2a6292ea9 req-47948fd9-aa85-41a7-988d-30bb8cce6e6e service nova] Creating event network-vif-deleted:8864dbfd-6219-4843-aa68-aea87851f10b for instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd on user Apr 14 04:27:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-9937cd1d-b599-4459-a121-36d2a6292ea9 req-47948fd9-aa85-41a7-988d-30bb8cce6e6e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046089 Apr 14 04:27:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 207/617] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "babb4943-f427-4d60-8c85-091fdae699ee"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-b472a2a2-973f-4d90-b27f-8b41b3325dc3 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367144 Apr 14 04:27:57 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 207/618] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:27:56 2023] POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-8912674f-88e2-4e5c-b091-828f1c641148 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75/action" status: 202 len: 0 microversion: 2.87 time: 0.087970 Apr 14 04:27:57 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 205/619] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:27:57 2023] POST /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:58 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:58 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:58 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:27:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-06d75559-e973-4a95-8cd1-94e04cbe1084 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 200 len: 1764 microversion: 2.87 time: 0.230605 Apr 14 04:27:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 208/620] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:27:57 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 1764 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:27:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-bdffe061-46a9-402b-bdaf-c4ad9416f1c2 req-8b7828e7-e6e8-4ab3-bc21-2205d790abd1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-unplugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:27:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bdffe061-46a9-402b-bdaf-c4ad9416f1c2 req-8b7828e7-e6e8-4ab3-bc21-2205d790abd1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:27:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bdffe061-46a9-402b-bdaf-c4ad9416f1c2 req-8b7828e7-e6e8-4ab3-bc21-2205d790abd1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:27:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bdffe061-46a9-402b-bdaf-c4ad9416f1c2 req-8b7828e7-e6e8-4ab3-bc21-2205d790abd1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:27:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-bdffe061-46a9-402b-bdaf-c4ad9416f1c2 req-8b7828e7-e6e8-4ab3-bc21-2205d790abd1 service nova] Creating event network-vif-unplugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:27:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-bdffe061-46a9-402b-bdaf-c4ad9416f1c2 req-8b7828e7-e6e8-4ab3-bc21-2205d790abd1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.033565 Apr 14 04:27:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 208/621] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:27:58 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-68d2ee88-f604-4a0c-9332-02157a5dd52d req-cf6ad0ec-63b3-4fd7-9c38-330909a30174 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-68d2ee88-f604-4a0c-9332-02157a5dd52d req-cf6ad0ec-63b3-4fd7-9c38-330909a30174 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-68d2ee88-f604-4a0c-9332-02157a5dd52d req-cf6ad0ec-63b3-4fd7-9c38-330909a30174 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-68d2ee88-f604-4a0c-9332-02157a5dd52d req-cf6ad0ec-63b3-4fd7-9c38-330909a30174 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-68d2ee88-f604-4a0c-9332-02157a5dd52d req-cf6ad0ec-63b3-4fd7-9c38-330909a30174 service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:28:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-68d2ee88-f604-4a0c-9332-02157a5dd52d req-cf6ad0ec-63b3-4fd7-9c38-330909a30174 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050111 Apr 14 04:28:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 206/622] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-82901559-c3b2-4b13-adf0-20b01f6d1c6d req-653b1eec-faee-4292-a0d3-f7a2ef3fc6cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}, {"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-82901559-c3b2-4b13-adf0-20b01f6d1c6d req-653b1eec-faee-4292-a0d3-f7a2ef3fc6cd service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-82901559-c3b2-4b13-adf0-20b01f6d1c6d req-653b1eec-faee-4292-a0d3-f7a2ef3fc6cd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-82901559-c3b2-4b13-adf0-20b01f6d1c6d req-653b1eec-faee-4292-a0d3-f7a2ef3fc6cd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-82901559-c3b2-4b13-adf0-20b01f6d1c6d req-653b1eec-faee-4292-a0d3-f7a2ef3fc6cd service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:28:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-82901559-c3b2-4b13-adf0-20b01f6d1c6d req-653b1eec-faee-4292-a0d3-f7a2ef3fc6cd service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:28:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-82901559-c3b2-4b13-adf0-20b01f6d1c6d req-653b1eec-faee-4292-a0d3-f7a2ef3fc6cd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.033920 Apr 14 04:28:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 209/623] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:02 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:05 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lazy-loading 'services' on Instance uuid f593ceb0-de44-490b-b365-3a05a3acd066 {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:28:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a0d37cbc-e6a4-4b73-83fb-b1f6705982c4 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/babb4943-f427-4d60-8c85-091fdae699ee" status: 202 len: 0 microversion: 2.1 time: 0.161094 Apr 14 04:28:05 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 209/624] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:28:05 2023] DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/babb4943-f427-4d60-8c85-091fdae699ee => generated 0 bytes in 163 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:05 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-aa46c0ab-2313-4bab-a1e1-6eb504a408e5 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064033 Apr 14 04:28:05 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 207/625] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:28:05 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:06 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-9d9231b9-386e-43b0-b31c-3fa176317935 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 200 len: 1704 microversion: 2.1 time: 0.469392 Apr 14 04:28:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 210/626] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:05 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 1704 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:08 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-59199015-9cf7-41ab-8f46-f7ad389e5b67 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1435 microversion: 2.1 time: 0.196473 Apr 14 04:28:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 210/627] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:08 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1435 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:28:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-90f051ad-6d0e-4b11-99ba-61b25b852e81 req-2324e09e-555f-425e-a838-d5157d70b3d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-90f051ad-6d0e-4b11-99ba-61b25b852e81 req-2324e09e-555f-425e-a838-d5157d70b3d3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-90f051ad-6d0e-4b11-99ba-61b25b852e81 req-2324e09e-555f-425e-a838-d5157d70b3d3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-90f051ad-6d0e-4b11-99ba-61b25b852e81 req-2324e09e-555f-425e-a838-d5157d70b3d3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-90f051ad-6d0e-4b11-99ba-61b25b852e81 req-2324e09e-555f-425e-a838-d5157d70b3d3 service nova] Creating event network-changed:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:28:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-90f051ad-6d0e-4b11-99ba-61b25b852e81 req-2324e09e-555f-425e-a838-d5157d70b3d3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029351 Apr 14 04:28:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 208/628] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:10 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lazy-loading 'flavor' on Instance uuid 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:28:11 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b4f707de-ae1c-47af-8554-49fd3aefd32b tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71/action" status: 202 len: 0 microversion: 2.1 time: 0.130454 Apr 14 04:28:11 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 211/629] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:28:10 2023] POST /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:11 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-203156d3-3471-4a68-9d2c-103907d1b881 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1441 microversion: 2.1 time: 0.199930 Apr 14 04:28:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 211/630] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:11 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1441 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:28:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-5ec41c77-2332-46dc-a09f-b3e5ae5e852f req-df693537-6f3a-4d3d-8f93-b99df0b1f9f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-unplugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}, {"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-plugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=19 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5ec41c77-2332-46dc-a09f-b3e5ae5e852f req-df693537-6f3a-4d3d-8f93-b99df0b1f9f7 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5ec41c77-2332-46dc-a09f-b3e5ae5e852f req-df693537-6f3a-4d3d-8f93-b99df0b1f9f7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5ec41c77-2332-46dc-a09f-b3e5ae5e852f req-df693537-6f3a-4d3d-8f93-b99df0b1f9f7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5ec41c77-2332-46dc-a09f-b3e5ae5e852f req-df693537-6f3a-4d3d-8f93-b99df0b1f9f7 service nova] Creating event network-vif-unplugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:28:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5ec41c77-2332-46dc-a09f-b3e5ae5e852f req-df693537-6f3a-4d3d-8f93-b99df0b1f9f7 service nova] Creating event network-vif-plugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:28:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-5ec41c77-2332-46dc-a09f-b3e5ae5e852f req-df693537-6f3a-4d3d-8f93-b99df0b1f9f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.032141 Apr 14 04:28:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 209/631] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:12 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6e826a50-e75a-46d0-bb59-24f5b6b51bf2 req-90304a74-ccb0-40b5-b2ca-6769e5ee705a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6e826a50-e75a-46d0-bb59-24f5b6b51bf2 req-90304a74-ccb0-40b5-b2ca-6769e5ee705a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6e826a50-e75a-46d0-bb59-24f5b6b51bf2 req-90304a74-ccb0-40b5-b2ca-6769e5ee705a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6e826a50-e75a-46d0-bb59-24f5b6b51bf2 req-90304a74-ccb0-40b5-b2ca-6769e5ee705a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6e826a50-e75a-46d0-bb59-24f5b6b51bf2 req-90304a74-ccb0-40b5-b2ca-6769e5ee705a service nova] Creating event network-changed:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:28:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6e826a50-e75a-46d0-bb59-24f5b6b51bf2 req-90304a74-ccb0-40b5-b2ca-6769e5ee705a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031755 Apr 14 04:28:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 212/632] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:16 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-02f8dd82-18e0-49de-a01e-bba853f21141 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1721 microversion: 2.1 time: 0.155447 Apr 14 04:28:16 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 212/633] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:16 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:17 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lazy-loading 'services' on Instance uuid 4a1c695b-2ca4-4652-8fb6-19accdab6ebe {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:28:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b52986d0-2b12-488b-ad7b-ae07ddc568f9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe/os-volume_attachments/b9113785-28aa-46da-ae7d-d2f2e9a011b2" status: 202 len: 0 microversion: 2.1 time: 0.214984 Apr 14 04:28:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 210/634] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:28:17 2023] DELETE /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe/os-volume_attachments/b9113785-28aa-46da-ae7d-d2f2e9a011b2 => generated 0 bytes in 217 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:17 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:28:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-33c9f5af-aa2a-409b-b1f2-9214042a00c2 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe" status: 204 len: 0 microversion: 2.1 time: 0.114365 Apr 14 04:28:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 213/635] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:28:17 2023] DELETE /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe => generated 0 bytes in 117 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:17 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e4a70281d6734c15b3c4b1b00e4b5d44', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0848c9a67e2746e5b12b73920215b729', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:17 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-1f2cb38e-7909-4cb6-a66b-62eea17c96eb tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe" status: 200 len: 1547 microversion: 2.1 time: 0.150768 Apr 14 04:28:17 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 213/636] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:17 2023] GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe => generated 1547 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:28:19 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-306ae5ee-c61e-4776-9516-d21d0ff63ced req-037470eb-e477-4442-ba24-14815ca04262 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1c695b-2ca4-4652-8fb6-19accdab6ebe", "name": "network-vif-unplugged", "status": "completed", "tag": "260596e7-554d-4e86-b146-fe487c284c83"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-306ae5ee-c61e-4776-9516-d21d0ff63ced req-037470eb-e477-4442-ba24-14815ca04262 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-306ae5ee-c61e-4776-9516-d21d0ff63ced req-037470eb-e477-4442-ba24-14815ca04262 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:19 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-306ae5ee-c61e-4776-9516-d21d0ff63ced req-037470eb-e477-4442-ba24-14815ca04262 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:19 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-306ae5ee-c61e-4776-9516-d21d0ff63ced req-037470eb-e477-4442-ba24-14815ca04262 service nova] Creating event network-vif-unplugged:260596e7-554d-4e86-b146-fe487c284c83 for instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe on user Apr 14 04:28:19 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-306ae5ee-c61e-4776-9516-d21d0ff63ced req-037470eb-e477-4442-ba24-14815ca04262 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032200 Apr 14 04:28:19 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 211/637] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:19 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-197c28db-2736-4075-9daf-ed9becad42b4 req-7ec4205a-167b-4df2-8589-e5a84bc7069f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1c695b-2ca4-4652-8fb6-19accdab6ebe", "name": "network-vif-deleted", "tag": "260596e7-554d-4e86-b146-fe487c284c83"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-197c28db-2736-4075-9daf-ed9becad42b4 req-7ec4205a-167b-4df2-8589-e5a84bc7069f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-197c28db-2736-4075-9daf-ed9becad42b4 req-7ec4205a-167b-4df2-8589-e5a84bc7069f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-197c28db-2736-4075-9daf-ed9becad42b4 req-7ec4205a-167b-4df2-8589-e5a84bc7069f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-197c28db-2736-4075-9daf-ed9becad42b4 req-7ec4205a-167b-4df2-8589-e5a84bc7069f service nova] Creating event network-vif-deleted:260596e7-554d-4e86-b146-fe487c284c83 for instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe on user Apr 14 04:28:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-197c28db-2736-4075-9daf-ed9becad42b4 req-7ec4205a-167b-4df2-8589-e5a84bc7069f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032057 Apr 14 04:28:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 214/638] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f7c956c4-e7b2-4557-badc-fd4e665bc8b9 req-bb17b551-fa48-499c-86b3-ef791bb4cbd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a1c695b-2ca4-4652-8fb6-19accdab6ebe", "name": "network-vif-plugged", "status": "completed", "tag": "260596e7-554d-4e86-b146-fe487c284c83"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f7c956c4-e7b2-4557-badc-fd4e665bc8b9 req-bb17b551-fa48-499c-86b3-ef791bb4cbd8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f7c956c4-e7b2-4557-badc-fd4e665bc8b9 req-bb17b551-fa48-499c-86b3-ef791bb4cbd8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f7c956c4-e7b2-4557-badc-fd4e665bc8b9 req-bb17b551-fa48-499c-86b3-ef791bb4cbd8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f7c956c4-e7b2-4557-badc-fd4e665bc8b9 req-bb17b551-fa48-499c-86b3-ef791bb4cbd8 service nova] Creating event network-vif-plugged:260596e7-554d-4e86-b146-fe487c284c83 for instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe on user Apr 14 04:28:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f7c956c4-e7b2-4557-badc-fd4e665bc8b9 req-bb17b551-fa48-499c-86b3-ef791bb4cbd8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030624 Apr 14 04:28:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 214/639] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=5 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=12,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=69,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:28:43 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd HTTP/1.1 Apr 14 04:28:43 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:28:43 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:28:43 user devstack@n-api.service[61595]: Connection: close Apr 14 04:28:43 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:28:43 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:28:43 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:28:43 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:28:43 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:28:43 user devstack@n-api.service[61595]: method: > Apr 14 04:28:43 user devstack@n-api.service[61595]: exception: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61595]: action_args: {'id': 'aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd'} Apr 14 04:28:43 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:28:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-bd989aab-5e65-469d-a618-e3d6ac5e7cdd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 404 len: 111 microversion: 2.1 time: 0.037007 Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:43 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 212/640] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:43 2023] GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=7 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d97ffdef-da42-4092-848f-e84c1b600fe5 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047581 Apr 14 04:28:43 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 215/641] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:28:43 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:28:43 user devstack@n-api.service[61597]: request: DELETE /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd HTTP/1.1 Apr 14 04:28:43 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:28:43 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:28:43 user devstack@n-api.service[61597]: Connection: close Apr 14 04:28:43 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:28:43 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:28:43 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:28:43 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:28:43 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:28:43 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61597]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:28:43 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61597]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:28:43 user devstack@n-api.service[61597]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:28:43 user devstack@n-api.service[61597]: method: > Apr 14 04:28:43 user devstack@n-api.service[61597]: exception: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61597]: action_args: {'id': 'aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd'} Apr 14 04:28:43 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:28:43 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9646bb48-611e-43b6-b40d-491e12b223ad tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 404 len: 111 microversion: 2.1 time: 0.045157 Apr 14 04:28:43 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 215/642] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:28:43 2023] DELETE /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:28:43 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd HTTP/1.1 Apr 14 04:28:43 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:28:43 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:28:43 user devstack@n-api.service[61596]: Connection: close Apr 14 04:28:43 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:28:43 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:28:43 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:28:43 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:28:43 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:28:43 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:28:43 user devstack@n-api.service[61596]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:28:43 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61596]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:28:43 user devstack@n-api.service[61596]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:28:43 user devstack@n-api.service[61596]: method: > Apr 14 04:28:43 user devstack@n-api.service[61596]: exception: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61596]: action_args: {'id': 'aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd'} Apr 14 04:28:43 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. Apr 14 04:28:43 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:28:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5b5019cc-01ae-4b20-af32-fe9d06948785 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd" status: 404 len: 111 microversion: 2.1 time: 0.035810 Apr 14 04:28:43 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 216/643] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:43 2023] GET /compute/v2.1/servers/aa8312da-d5e6-4ca7-a7b0-e11ed3351bdd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:28:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] HTTP exception thrown: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 is not attached to volume d8f57c49-602f-450f-8b9e-69f1f0255cee Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Request method failure captured: Apr 14 04:28:43 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments/d8f57c49-602f-450f-8b9e-69f1f0255cee HTTP/1.1 Apr 14 04:28:43 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:28:43 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:28:43 user devstack@n-api.service[61595]: Connection: close Apr 14 04:28:43 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:28:43 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:28:43 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:28:43 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:28:43 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONPmOoVtJAGLFUqi790xjd6yAgn1Mr0hQlpr-3r6seQZuXjK_zTQAX5XhYT1vIJVPL97tNWIEVIteW1KsXSLIUZqr5VBGYGSlaw6pxGVP6EIdjFYKI3Gpbot4VU-_rTtvJ5g3gi32e1KkyfmUvqgoknW0f0J5rjXRQ7OW8dqHGEU4TY Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}] Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Tenant: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Tenant-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Id: 982f167333954612a51911fc8d6c1ce9 Apr 14 04:28:43 user devstack@n-api.service[61595]: X-User-Name: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:28:43 user devstack@n-api.service[61595]: method: > Apr 14 04:28:43 user devstack@n-api.service[61595]: exception: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 is not attached to volume d8f57c49-602f-450f-8b9e-69f1f0255cee Apr 14 04:28:43 user devstack@n-api.service[61595]: action_args: {'server_id': '5273d202-ffc5-43c6-bb4f-f6d1a6855271', 'id': 'd8f57c49-602f-450f-8b9e-69f1f0255cee'} Apr 14 04:28:43 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id d8f57c49-602f-450f-8b9e-69f1f0255cee. Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 is not attached to volume d8f57c49-602f-450f-8b9e-69f1f0255cee Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 is not attached to volume d8f57c49-602f-450f-8b9e-69f1f0255cee Apr 14 04:28:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:28:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Returning 404 to user: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 is not attached to volume d8f57c49-602f-450f-8b9e-69f1f0255cee {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:28:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ff1d8072-839f-4249-ba06-7bb4e41b8043 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments/d8f57c49-602f-450f-8b9e-69f1f0255cee" status: 404 len: 154 microversion: 2.1 time: 0.103319 Apr 14 04:28:43 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 213/644] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:28:43 2023] DELETE /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271/os-volume_attachments/d8f57c49-602f-450f-8b9e-69f1f0255cee => generated 154 bytes in 104 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f3eafbc6-82c4-4f11-9a7d-e9602d902cfa tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.102575 Apr 14 04:28:47 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 216/645] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:28:47 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-interface => generated 282 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:28:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3e53c2d0-bf77-4f3a-a00d-a87d5f561594 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 204 len: 0 microversion: 2.1 time: 0.117737 Apr 14 04:28:47 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 217/646] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:28:47 2023] DELETE /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:47 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '982f167333954612a51911fc8d6c1ce9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0a60f60717b44f4ba904a949eabfe608', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:47 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-943fecad-9279-422e-85a8-6397a7ea6523 tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 200 len: 1540 microversion: 2.1 time: 0.256110 Apr 14 04:28:47 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 214/647] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:47 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 1540 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-4cf20fe3-749a-4c74-84eb-403500dff98a req-33a870a1-e948-4acb-8814-2184f2c542d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-unplugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4cf20fe3-749a-4c74-84eb-403500dff98a req-33a870a1-e948-4acb-8814-2184f2c542d8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4cf20fe3-749a-4c74-84eb-403500dff98a req-33a870a1-e948-4acb-8814-2184f2c542d8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4cf20fe3-749a-4c74-84eb-403500dff98a req-33a870a1-e948-4acb-8814-2184f2c542d8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-4cf20fe3-749a-4c74-84eb-403500dff98a req-33a870a1-e948-4acb-8814-2184f2c542d8 service nova] Creating event network-vif-unplugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:28:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-4cf20fe3-749a-4c74-84eb-403500dff98a req-33a870a1-e948-4acb-8814-2184f2c542d8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038949 Apr 14 04:28:47 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 217/648] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:47 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-698bb1b9-f829-43f1-9dba-1f0d50c4903a req-96f3edc5-b458-4c77-8eed-426ba00c0da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19eb131-ae90-4220-9d47-15e8b8b332de", "tag": "fab305ad-6649-4e13-944b-82a2dbc76547"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-698bb1b9-f829-43f1-9dba-1f0d50c4903a req-96f3edc5-b458-4c77-8eed-426ba00c0da7 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-698bb1b9-f829-43f1-9dba-1f0d50c4903a req-96f3edc5-b458-4c77-8eed-426ba00c0da7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-698bb1b9-f829-43f1-9dba-1f0d50c4903a req-96f3edc5-b458-4c77-8eed-426ba00c0da7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-698bb1b9-f829-43f1-9dba-1f0d50c4903a req-96f3edc5-b458-4c77-8eed-426ba00c0da7 service nova] Creating event network-changed:fab305ad-6649-4e13-944b-82a2dbc76547 for instance e19eb131-ae90-4220-9d47-15e8b8b332de on user Apr 14 04:28:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-698bb1b9-f829-43f1-9dba-1f0d50c4903a req-96f3edc5-b458-4c77-8eed-426ba00c0da7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035677 Apr 14 04:28:48 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 218/649] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:48 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6d669ee2-0f58-447d-8288-6cac91cb8caf tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/ips" status: 200 len: 103 microversion: 2.1 time: 0.050408 Apr 14 04:28:48 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 215/650] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:28:48 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/ips => generated 103 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:48 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4951752d-beef-4977-a433-5af1f4847945 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 200 len: 1770 microversion: 2.87 time: 0.218192 Apr 14 04:28:48 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 218/651] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:28:48 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 1770 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:28:48 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-a48c1f70-ac20-47df-b8c1-dc7b937fe539 req-185963de-cd6a-418a-ab21-626898f69653 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-deleted", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a48c1f70-ac20-47df-b8c1-dc7b937fe539 req-185963de-cd6a-418a-ab21-626898f69653 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a48c1f70-ac20-47df-b8c1-dc7b937fe539 req-185963de-cd6a-418a-ab21-626898f69653 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a48c1f70-ac20-47df-b8c1-dc7b937fe539 req-185963de-cd6a-418a-ab21-626898f69653 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-a48c1f70-ac20-47df-b8c1-dc7b937fe539 req-185963de-cd6a-418a-ab21-626898f69653 service nova] Creating event network-vif-deleted:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:28:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-a48c1f70-ac20-47df-b8c1-dc7b937fe539 req-185963de-cd6a-418a-ab21-626898f69653 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046259 Apr 14 04:28:48 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 219/652] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:49 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-03502063-9e20-4c49-918c-d9ea1b0d141e req-0dfc928c-7481-45b6-8324-67617fa7aa0c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5273d202-ffc5-43c6-bb4f-f6d1a6855271", "name": "network-vif-plugged", "status": "completed", "tag": "dc662cd5-f74a-40ee-bc14-e0948cbc4f36"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-03502063-9e20-4c49-918c-d9ea1b0d141e req-0dfc928c-7481-45b6-8324-67617fa7aa0c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-03502063-9e20-4c49-918c-d9ea1b0d141e req-0dfc928c-7481-45b6-8324-67617fa7aa0c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-03502063-9e20-4c49-918c-d9ea1b0d141e req-0dfc928c-7481-45b6-8324-67617fa7aa0c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:49 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-03502063-9e20-4c49-918c-d9ea1b0d141e req-0dfc928c-7481-45b6-8324-67617fa7aa0c service nova] Creating event network-vif-plugged:dc662cd5-f74a-40ee-bc14-e0948cbc4f36 for instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 on user Apr 14 04:28:49 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-03502063-9e20-4c49-918c-d9ea1b0d141e req-0dfc928c-7481-45b6-8324-67617fa7aa0c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029735 Apr 14 04:28:49 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 216/653] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e11df2cb-b474-4faf-afdf-a1c4e7d905ad"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:50 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9998eb89-ab73-4040-8321-89ceb17dde8e tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.294697 Apr 14 04:28:50 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 219/654] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:28:50 2023] POST /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments => generated 194 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-volume-backed-server-2095931005", "imageRef": "", "flavorRef": "42", "block_device_mapping_v2": [{"uuid": "300999d2-cadf-4299-8a05-85dec6b7d895", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}], "networks": [{"uuid": "e20e0d94-3b17-4872-b774-3a724d3a253b"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] validate_networks() for [('e20e0d94-3b17-4872-b774-3a724d3a253b', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for user bcf79de7da27495dbfd14c556b5b54c7 and project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:28:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='300999d2-cadf-4299-8a05-85dec6b7d895',volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:28:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-8dc52a68-e0d6-4c29-afcf-a93f323ccd72 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.725938 Apr 14 04:28:54 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 220/655] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:28:54 2023] POST /compute/v2.1/servers => generated 378 bytes in 729 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:28:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-80aa66b3-6b00-4667-92ea-dfa99c2ef4c3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:54 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-80aa66b3-6b00-4667-92ea-dfa99c2ef4c3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:55 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-80aa66b3-6b00-4667-92ea-dfa99c2ef4c3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:28:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-80aa66b3-6b00-4667-92ea-dfa99c2ef4c3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 200 len: 1066 microversion: 2.1 time: 0.071491 Apr 14 04:28:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 217/656] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:28:54 2023] GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 1066 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:55 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-c3b16e44-1e55-4087-91f9-8a2a886d4758 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.219858 Apr 14 04:28:55 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 220/657] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:28:55 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 25 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:28:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-5e336311-5aff-46f3-a8e8-071581fb8cfd req-293b48a8-14a3-419f-bbbe-f31e55b056e4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "af7befec-3f77-4eb7-be53-d1b1e791713e", "tag": "0b301be3-2fd0-4e29-9740-a2ce2193d477"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5e336311-5aff-46f3-a8e8-071581fb8cfd req-293b48a8-14a3-419f-bbbe-f31e55b056e4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5e336311-5aff-46f3-a8e8-071581fb8cfd req-293b48a8-14a3-419f-bbbe-f31e55b056e4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5e336311-5aff-46f3-a8e8-071581fb8cfd req-293b48a8-14a3-419f-bbbe-f31e55b056e4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5e336311-5aff-46f3-a8e8-071581fb8cfd req-293b48a8-14a3-419f-bbbe-f31e55b056e4 service nova] Creating event network-changed:0b301be3-2fd0-4e29-9740-a2ce2193d477 for instance af7befec-3f77-4eb7-be53-d1b1e791713e on user Apr 14 04:28:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-5e336311-5aff-46f3-a8e8-071581fb8cfd req-293b48a8-14a3-419f-bbbe-f31e55b056e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043882 Apr 14 04:28:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 221/658] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:28:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-76770987-3e17-4f9b-91c7-04a23dd17b5d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044208 Apr 14 04:28:58 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 218/659] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:28:58 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-adf7cc00-660d-479d-b8f4-06121188f87d tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/e11df2cb-b474-4faf-afdf-a1c4e7d905ad" status: 200 len: 194 microversion: 2.1 time: 0.047715 Apr 14 04:28:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 221/660] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 04:28:58 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/e11df2cb-b474-4faf-afdf-a1c4e7d905ad => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "90c1922d-91ec-49ff-8993-980caa04a670"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:28:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:28:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-04f34ad2-6881-4c9d-9898-a918ed540016 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335962 Apr 14 04:28:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 222/661] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:28:59 2023] POST /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 194 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "43b7dada-23d8-4db0-9be7-b0fff3287b15"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3b844cad-6161-4c3c-9e19-c0f4e265b84f tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "POST /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.288702 Apr 14 04:29:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 219/662] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:29:00 2023] POST /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:01 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:01 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ac7f7d0d-7481-4619-878c-4a398f0f6320 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1501 microversion: 2.1 time: 0.166493 Apr 14 04:29:01 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 222/663] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:01 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1501 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:29:04 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1e44a58c-951d-46c3-931e-e5fd707bc2eb req-1bc36952-60e2-448e-84d2-de4ef433382f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7befec-3f77-4eb7-be53-d1b1e791713e", "name": "network-vif-plugged", "status": "completed", "tag": "0b301be3-2fd0-4e29-9740-a2ce2193d477"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1e44a58c-951d-46c3-931e-e5fd707bc2eb req-1bc36952-60e2-448e-84d2-de4ef433382f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1e44a58c-951d-46c3-931e-e5fd707bc2eb req-1bc36952-60e2-448e-84d2-de4ef433382f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1e44a58c-951d-46c3-931e-e5fd707bc2eb req-1bc36952-60e2-448e-84d2-de4ef433382f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1e44a58c-951d-46c3-931e-e5fd707bc2eb req-1bc36952-60e2-448e-84d2-de4ef433382f service nova] Creating event network-vif-plugged:0b301be3-2fd0-4e29-9740-a2ce2193d477 for instance af7befec-3f77-4eb7-be53-d1b1e791713e on user Apr 14 04:29:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1e44a58c-951d-46c3-931e-e5fd707bc2eb req-1bc36952-60e2-448e-84d2-de4ef433382f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069122 Apr 14 04:29:04 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 223/664] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-88e83a50-998c-46ef-b949-fb067a773085 req-e0dd6915-308b-4ca9-b643-96abdecbe3df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7befec-3f77-4eb7-be53-d1b1e791713e", "name": "network-vif-plugged", "status": "completed", "tag": "0b301be3-2fd0-4e29-9740-a2ce2193d477"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-88e83a50-998c-46ef-b949-fb067a773085 req-e0dd6915-308b-4ca9-b643-96abdecbe3df service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-88e83a50-998c-46ef-b949-fb067a773085 req-e0dd6915-308b-4ca9-b643-96abdecbe3df service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-88e83a50-998c-46ef-b949-fb067a773085 req-e0dd6915-308b-4ca9-b643-96abdecbe3df service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-88e83a50-998c-46ef-b949-fb067a773085 req-e0dd6915-308b-4ca9-b643-96abdecbe3df service nova] Creating event network-vif-plugged:0b301be3-2fd0-4e29-9740-a2ce2193d477 for instance af7befec-3f77-4eb7-be53-d1b1e791713e on user Apr 14 04:29:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-88e83a50-998c-46ef-b949-fb067a773085 req-e0dd6915-308b-4ca9-b643-96abdecbe3df service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055596 Apr 14 04:29:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 220/665] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] HTTP exception thrown: Cannot 'detach_volume' instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c while it is in vm_state rescued Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Request method failure captured: Apr 14 04:29:06 user devstack@n-api.service[61597]: request: DELETE /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments/2ea04249-09da-471f-a8b5-89a901381329 HTTP/1.1 Apr 14 04:29:06 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:29:06 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:29:06 user devstack@n-api.service[61597]: Connection: close Apr 14 04:29:06 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:29:06 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:29:06 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:29:06 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:29:06 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOmH01Hutb9YRw7uP2OlEp2aln8h5oMlw6e03I64C0rdRlcywArRqsgHVh8sCAN_UYylqj-A4cprpWb6TM90dGEKDnyOXHJIuIWR9Q1QhB-vCRVDiHxb9uvmuCKQGukmWIvHvqEv-t6izPrze6I7q7h7D4ZERz8pfCORUpGc7P915g Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Project-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}] Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Tenant-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:29:06 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:29:06 user devstack@n-api.service[61597]: X-User: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:29:06 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:29:06 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:29:06 user devstack@n-api.service[61597]: X-User-Id: 5234914aec8e443b8a38ac6b38729031 Apr 14 04:29:06 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:29:06 user devstack@n-api.service[61597]: method: > Apr 14 04:29:06 user devstack@n-api.service[61597]: exception: Cannot 'detach_volume' instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c while it is in vm_state rescued Apr 14 04:29:06 user devstack@n-api.service[61597]: action_args: {'server_id': 'cab84e5c-99ba-4e61-bf68-0a02b31ded5c', 'id': '2ea04249-09da-471f-a8b5-89a901381329'} Apr 14 04:29:06 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c in vm_state rescued. Cannot detach_volume while the instance is in this state. Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c while it is in vm_state rescued Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c while it is in vm_state rescued Apr 14 04:29:06 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Returning 409 to user: Cannot 'detach_volume' instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c while it is in vm_state rescued {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:29:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-766687b3-faf9-493f-a39b-9d2822bc01bb tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments/2ea04249-09da-471f-a8b5-89a901381329" status: 409 len: 152 microversion: 2.1 time: 0.113385 Apr 14 04:29:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 223/666] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:29:06 2023] DELETE /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments/2ea04249-09da-471f-a8b5-89a901381329 => generated 152 bytes in 115 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:06 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:06 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-58d4cc6f-3d16-4cfb-aee8-a1b54ad14449 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "POST /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/action" status: 202 len: 0 microversion: 2.1 time: 0.083829 Apr 14 04:29:06 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 224/667] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:29:06 2023] POST /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/action => generated 0 bytes in 85 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:07 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d3313d65-f52d-4fe4-91dc-b57d1e196854 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 200 len: 1712 microversion: 2.1 time: 0.297917 Apr 14 04:29:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 221/668] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:06 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 1712 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:29:07 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-e0c411d5-755e-4355-b34c-cbb953bc91ee req-d958b08e-a724-4d07-a724-7c4e7c3a5bcb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-unplugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0c411d5-755e-4355-b34c-cbb953bc91ee req-d958b08e-a724-4d07-a724-7c4e7c3a5bcb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0c411d5-755e-4355-b34c-cbb953bc91ee req-d958b08e-a724-4d07-a724-7c4e7c3a5bcb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-e0c411d5-755e-4355-b34c-cbb953bc91ee req-d958b08e-a724-4d07-a724-7c4e7c3a5bcb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:07 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-e0c411d5-755e-4355-b34c-cbb953bc91ee req-d958b08e-a724-4d07-a724-7c4e7c3a5bcb service nova] Creating event network-vif-unplugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:29:07 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-e0c411d5-755e-4355-b34c-cbb953bc91ee req-d958b08e-a724-4d07-a724-7c4e7c3a5bcb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.045031 Apr 14 04:29:07 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 224/669] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:07 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] [instance: 4a1c695b-2ca4-4652-8fb6-19accdab6ebe] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] HTTP exception thrown: Instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe could not be found. Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Request method failure captured: Apr 14 04:29:07 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe HTTP/1.1 Apr 14 04:29:07 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:29:07 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:29:07 user devstack@n-api.service[61596]: Connection: close Apr 14 04:29:07 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:29:07 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:29:07 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:29:07 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:29:07 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONUDZklv-EAByjN7Boe22vvzGu20VIeAeyWgI21qWQHEpMiJJEjxvthc-_2s8vupsC3k6kZrDZY1tHB6pB3nFgcf41dTq3iy3tQKK08FsXR8E1yMjoSnGDpatdcMdTVL7ZqCDc2mG3ckIU-tOV1b2QZx238nlY4yZX9UPZkXg8-HRT4 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Project-Id: 0848c9a67e2746e5b12b73920215b729 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1226436274 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0848c9a67e2746e5b12b73920215b729"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0848c9a67e2746e5b12b73920215b729"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0848c9a67e2746e5b12b73920215b729"}]}] Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesSnapshotTestJSON-1226436274 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Tenant-Id: 0848c9a67e2746e5b12b73920215b729 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1226436274 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-User: tempest-VolumesSnapshotTestJSON-1226436274-project-member Apr 14 04:29:07 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:29:07 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:29:07 user devstack@n-api.service[61596]: X-User-Id: e4a70281d6734c15b3c4b1b00e4b5d44 Apr 14 04:29:07 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesSnapshotTestJSON-1226436274-project-member Apr 14 04:29:07 user devstack@n-api.service[61596]: method: > Apr 14 04:29:07 user devstack@n-api.service[61596]: exception: Instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe could not be found. Apr 14 04:29:07 user devstack@n-api.service[61596]: action_args: {'id': '4a1c695b-2ca4-4652-8fb6-19accdab6ebe'} Apr 14 04:29:07 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe could not be found. Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe could not be found. Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe could not be found. Apr 14 04:29:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:29:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] Returning 404 to user: Instance 4a1c695b-2ca4-4652-8fb6-19accdab6ebe could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:29:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3458f3b9-bb74-423d-aea7-2f81f1b8eba9 tempest-VolumesSnapshotTestJSON-1226436274 tempest-VolumesSnapshotTestJSON-1226436274-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe" status: 404 len: 111 microversion: 2.1 time: 0.055889 Apr 14 04:29:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 225/670] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:07 2023] GET /compute/v2.1/servers/4a1c695b-2ca4-4652-8fb6-19accdab6ebe => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:08 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lazy-loading 'services' on Instance uuid f593ceb0-de44-490b-b365-3a05a3acd066 {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:29:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d07c6827-353d-479e-ab45-80aa4c20784d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/90c1922d-91ec-49ff-8993-980caa04a670" status: 202 len: 0 microversion: 2.1 time: 0.172523 Apr 14 04:29:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 222/671] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:29:08 2023] DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments/90c1922d-91ec-49ff-8993-980caa04a670 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0c196d36-cc4c-4404-9461-7a83d207b648 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093529 Apr 14 04:29:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 225/672] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:29:08 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:09 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-fe378f0f-1702-47b3-9ce8-581f85dcc210 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048513 Apr 14 04:29:09 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 226/673] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:29:09 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:09 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:09 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b65e64d2-fba3-4ad6-8d2e-eebdc794cb08 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/e11df2cb-b474-4faf-afdf-a1c4e7d905ad" status: 200 len: 194 microversion: 2.1 time: 0.056331 Apr 14 04:29:09 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 223/674] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 04:29:09 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/e11df2cb-b474-4faf-afdf-a1c4e7d905ad => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:09 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lazy-loading 'services' on Instance uuid e19eb131-ae90-4220-9d47-15e8b8b332de {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:29:09 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-b0cbb7c8-7e0d-44a1-8a54-9f66631c066c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/e11df2cb-b474-4faf-afdf-a1c4e7d905ad" status: 202 len: 0 microversion: 2.1 time: 0.217918 Apr 14 04:29:09 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 226/675] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:29:09 2023] DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/e11df2cb-b474-4faf-afdf-a1c4e7d905ad => generated 0 bytes in 220 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-3a6b9369-e3cf-4bfc-b74f-fc72691fd8ce req-723f0f74-4669-4e5e-be73-662f6c26f784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3a6b9369-e3cf-4bfc-b74f-fc72691fd8ce req-723f0f74-4669-4e5e-be73-662f6c26f784 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3a6b9369-e3cf-4bfc-b74f-fc72691fd8ce req-723f0f74-4669-4e5e-be73-662f6c26f784 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:09 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3a6b9369-e3cf-4bfc-b74f-fc72691fd8ce req-723f0f74-4669-4e5e-be73-662f6c26f784 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:09 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-3a6b9369-e3cf-4bfc-b74f-fc72691fd8ce req-723f0f74-4669-4e5e-be73-662f6c26f784 service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:29:09 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-3a6b9369-e3cf-4bfc-b74f-fc72691fd8ce req-723f0f74-4669-4e5e-be73-662f6c26f784 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045856 Apr 14 04:29:09 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 227/676] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:09 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-b5d0dbfe-9694-4bca-bac6-90f489f1944b req-58784aaa-83d6-459b-b06f-aa17802ea4b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}, {"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b5d0dbfe-9694-4bca-bac6-90f489f1944b req-58784aaa-83d6-459b-b06f-aa17802ea4b2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b5d0dbfe-9694-4bca-bac6-90f489f1944b req-58784aaa-83d6-459b-b06f-aa17802ea4b2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b5d0dbfe-9694-4bca-bac6-90f489f1944b req-58784aaa-83d6-459b-b06f-aa17802ea4b2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-b5d0dbfe-9694-4bca-bac6-90f489f1944b req-58784aaa-83d6-459b-b06f-aa17802ea4b2 service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:29:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-b5d0dbfe-9694-4bca-bac6-90f489f1944b req-58784aaa-83d6-459b-b06f-aa17802ea4b2 service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:29:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-b5d0dbfe-9694-4bca-bac6-90f489f1944b req-58784aaa-83d6-459b-b06f-aa17802ea4b2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031113 Apr 14 04:29:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 224/677] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:11 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fd94efb8-6398-4ff4-9f3a-2789ca8edb8a tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/43b7dada-23d8-4db0-9be7-b0fff3287b15" status: 200 len: 194 microversion: 2.1 time: 0.041719 Apr 14 04:29:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 227/678] 10.0.0.210 () {62 vars in 1490 bytes} [Fri Apr 14 04:29:11 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/43b7dada-23d8-4db0-9be7-b0fff3287b15 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:12 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lazy-loading 'services' on Instance uuid e19eb131-ae90-4220-9d47-15e8b8b332de {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:29:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d1f6a631-7fc8-4a3a-91ec-5655b3495bbe tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/43b7dada-23d8-4db0-9be7-b0fff3287b15" status: 202 len: 0 microversion: 2.1 time: 0.186796 Apr 14 04:29:12 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 228/679] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:29:11 2023] DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments/43b7dada-23d8-4db0-9be7-b0fff3287b15 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=29 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6338a0df-64e9-434b-83c1-8b22ae9b4c5c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070050 Apr 14 04:29:14 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 225/680] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:29:14 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=29 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:14 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=73,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-678f9534-656d-4656-a200-1b55b99a8bde tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054139 Apr 14 04:29:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 228/681] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:29:14 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:14 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:29:14 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-87c49308-34e4-47a7-9f62-d8042168a608 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de" status: 204 len: 0 microversion: 2.1 time: 0.130528 Apr 14 04:29:14 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 229/682] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:29:14 2023] DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:15 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7610b45003e34f3395268977612f6c94', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a89255339f74e55ad7c92967558bb81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:15 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-5ae32487-f410-40d6-aa6e-0317ddf07fc6 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de" status: 200 len: 1659 microversion: 2.1 time: 0.231755 Apr 14 04:29:15 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 226/683] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:14 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de => generated 1659 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:29:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-762d6596-3052-4a34-b64f-9635cad21da7 req-be0f9f70-d13f-4210-9a1e-df50356096e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19eb131-ae90-4220-9d47-15e8b8b332de", "name": "network-vif-unplugged", "status": "completed", "tag": "fab305ad-6649-4e13-944b-82a2dbc76547"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-762d6596-3052-4a34-b64f-9635cad21da7 req-be0f9f70-d13f-4210-9a1e-df50356096e0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-762d6596-3052-4a34-b64f-9635cad21da7 req-be0f9f70-d13f-4210-9a1e-df50356096e0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-762d6596-3052-4a34-b64f-9635cad21da7 req-be0f9f70-d13f-4210-9a1e-df50356096e0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-762d6596-3052-4a34-b64f-9635cad21da7 req-be0f9f70-d13f-4210-9a1e-df50356096e0 service nova] Creating event network-vif-unplugged:fab305ad-6649-4e13-944b-82a2dbc76547 for instance e19eb131-ae90-4220-9d47-15e8b8b332de on user Apr 14 04:29:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-762d6596-3052-4a34-b64f-9635cad21da7 req-be0f9f70-d13f-4210-9a1e-df50356096e0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.080591 Apr 14 04:29:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 229/684] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:15 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:16 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d39b0f3b-3c2c-49b1-ab80-dc8d7cb948fc tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1721 microversion: 2.1 time: 0.200616 Apr 14 04:29:16 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 230/685] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:16 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1721 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:17 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-9d066459-1efc-4aee-96fb-ed941406cca2 req-57d505d1-8b39-46f4-b6ba-800e5345c592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19eb131-ae90-4220-9d47-15e8b8b332de", "name": "network-vif-plugged", "status": "completed", "tag": "fab305ad-6649-4e13-944b-82a2dbc76547"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-9d066459-1efc-4aee-96fb-ed941406cca2 req-57d505d1-8b39-46f4-b6ba-800e5345c592 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-9d066459-1efc-4aee-96fb-ed941406cca2 req-57d505d1-8b39-46f4-b6ba-800e5345c592 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-9d066459-1efc-4aee-96fb-ed941406cca2 req-57d505d1-8b39-46f4-b6ba-800e5345c592 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:17 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-9d066459-1efc-4aee-96fb-ed941406cca2 req-57d505d1-8b39-46f4-b6ba-800e5345c592 service nova] Creating event network-vif-plugged:fab305ad-6649-4e13-944b-82a2dbc76547 for instance e19eb131-ae90-4220-9d47-15e8b8b332de on user Apr 14 04:29:17 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-9d066459-1efc-4aee-96fb-ed941406cca2 req-57d505d1-8b39-46f4-b6ba-800e5345c592 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036389 Apr 14 04:29:17 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 230/686] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:17 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b9b5e8df-09f2-4764-a9d0-8d9ec93be1e1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1721 microversion: 2.1 time: 0.732434 Apr 14 04:29:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 227/687] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:16 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1721 bytes in 734 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:29:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-281ecd1e-b4f0-4439-9a5d-b12af4b9a1bb req-a8a4c772-965a-436f-947d-c789fcc6caae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19eb131-ae90-4220-9d47-15e8b8b332de", "name": "network-vif-deleted", "tag": "fab305ad-6649-4e13-944b-82a2dbc76547"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-281ecd1e-b4f0-4439-9a5d-b12af4b9a1bb req-a8a4c772-965a-436f-947d-c789fcc6caae service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-281ecd1e-b4f0-4439-9a5d-b12af4b9a1bb req-a8a4c772-965a-436f-947d-c789fcc6caae service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-281ecd1e-b4f0-4439-9a5d-b12af4b9a1bb req-a8a4c772-965a-436f-947d-c789fcc6caae service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-281ecd1e-b4f0-4439-9a5d-b12af4b9a1bb req-a8a4c772-965a-436f-947d-c789fcc6caae service nova] Creating event network-vif-deleted:fab305ad-6649-4e13-944b-82a2dbc76547 for instance e19eb131-ae90-4220-9d47-15e8b8b332de on user Apr 14 04:29:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-281ecd1e-b4f0-4439-9a5d-b12af4b9a1bb req-a8a4c772-965a-436f-947d-c789fcc6caae service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039371 Apr 14 04:29:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 231/688] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=5 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=9 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] [instance: 5273d202-ffc5-43c6-bb4f-f6d1a6855271] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] HTTP exception thrown: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 could not be found. Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Request method failure captured: Apr 14 04:29:37 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 HTTP/1.1 Apr 14 04:29:37 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:29:37 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:29:37 user devstack@n-api.service[61597]: Connection: close Apr 14 04:29:37 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:29:37 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:29:37 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:29:37 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:29:37 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONPmOoVtJAGLFUqi790xjd6yAgn1Mr0hQlpr-3r6seQZuXjK_zTQAX5XhYT1vIJVPL97tNWIEVIteW1KsXSLIUZqr5VBGYGSlaw6pxGVP6EIdjFYKI3Gpbot4VU-_rTtvJ5g3gi32e1KkyfmUvqgoknW0f0J5rjXRQ7OW8dqHGEU4TY Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Project-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Project-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0a60f60717b44f4ba904a949eabfe608"}]}] Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Tenant: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Tenant-Id: 0a60f60717b44f4ba904a949eabfe608 Apr 14 04:29:37 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1872250892 Apr 14 04:29:37 user devstack@n-api.service[61597]: X-User: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:29:37 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:29:37 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:29:37 user devstack@n-api.service[61597]: X-User-Id: 982f167333954612a51911fc8d6c1ce9 Apr 14 04:29:37 user devstack@n-api.service[61597]: X-User-Name: tempest-TestMinimumBasicScenario-1872250892-project-member Apr 14 04:29:37 user devstack@n-api.service[61597]: method: > Apr 14 04:29:37 user devstack@n-api.service[61597]: exception: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 could not be found. Apr 14 04:29:37 user devstack@n-api.service[61597]: action_args: {'id': '5273d202-ffc5-43c6-bb4f-f6d1a6855271'} Apr 14 04:29:37 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 could not be found. Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 could not be found. Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 could not be found. Apr 14 04:29:37 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:29:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Returning 404 to user: Instance 5273d202-ffc5-43c6-bb4f-f6d1a6855271 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:29:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-572eec7d-6d1f-4955-bbf8-cedbee34ce2e tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271" status: 404 len: 111 microversion: 2.1 time: 0.041278 Apr 14 04:29:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 231/689] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:37 2023] GET /compute/v2.1/servers/5273d202-ffc5-43c6-bb4f-f6d1a6855271 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:29:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-453f4366-f439-48f8-9cf4-0da240e1e2bd tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] Calling method '.version_select at 0x7f538ac1cf70>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:37 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=5 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:37 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=17 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-453f4366-f439-48f8-9cf4-0da240e1e2bd tempest-TestMinimumBasicScenario-1872250892 tempest-TestMinimumBasicScenario-1872250892-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231821443" status: 202 len: 0 microversion: 2.1 time: 0.027288 Apr 14 04:29:37 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 228/690] 10.0.0.210 () {62 vars in 1346 bytes} [Fri Apr 14 04:29:37 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-231821443 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:45 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:45 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-18693e87-4e76-447d-9129-c1909e0ce1a6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 200 len: 1392 microversion: 2.1 time: 0.208124 Apr 14 04:29:45 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 232/691] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:45 2023] GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 1392 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:29:48 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-717082241", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "7457ae38-8cd9-4172-aa34-25b764436aee"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:48 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:48 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:48 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] validate_networks() for [('7457ae38-8cd9-4172-aa34-25b764436aee', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for user 6ec7103e06e643a6b9b2c908ba8d7b06 and project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:29:49 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:29:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3e679a9b-52e2-4f9a-ad02-5d079d685cd9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.706470 Apr 14 04:29:49 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 232/692] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 04:29:48 2023] POST /compute/v2.1/servers => generated 378 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:29:49 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:29:49 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0ea504f8-9ea6-44e4-ba80-1bc51136b89e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:49 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0ea504f8-9ea6-44e4-ba80-1bc51136b89e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:49 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-0ea504f8-9ea6-44e4-ba80-1bc51136b89e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:49 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-0ea504f8-9ea6-44e4-ba80-1bc51136b89e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:49 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-0ea504f8-9ea6-44e4-ba80-1bc51136b89e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:49 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0ea504f8-9ea6-44e4-ba80-1bc51136b89e tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc" status: 200 len: 1394 microversion: 2.87 time: 0.087567 Apr 14 04:29:49 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 229/693] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:29:49 2023] GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc => generated 1394 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:29:51 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6fda2180-c38e-43b4-ba75-5fe051c872b0 req-ea4e26f6-7c55-465c-97fa-d504e1bc9467 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "19a166de-f0c9-43f2-8c88-585e0d5d22cc", "tag": "e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6fda2180-c38e-43b4-ba75-5fe051c872b0 req-ea4e26f6-7c55-465c-97fa-d504e1bc9467 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6fda2180-c38e-43b4-ba75-5fe051c872b0 req-ea4e26f6-7c55-465c-97fa-d504e1bc9467 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6fda2180-c38e-43b4-ba75-5fe051c872b0 req-ea4e26f6-7c55-465c-97fa-d504e1bc9467 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6fda2180-c38e-43b4-ba75-5fe051c872b0 req-ea4e26f6-7c55-465c-97fa-d504e1bc9467 service nova] Creating event network-changed:e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d for instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc on user Apr 14 04:29:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6fda2180-c38e-43b4-ba75-5fe051c872b0 req-ea4e26f6-7c55-465c-97fa-d504e1bc9467 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039340 Apr 14 04:29:52 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 233/694] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-c8f03e6b-6f12-44c3-9fa2-e08288bca17d req-8a538126-043b-4595-a544-06f54e77b69f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a166de-f0c9-43f2-8c88-585e0d5d22cc", "name": "network-vif-plugged", "status": "completed", "tag": "e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c8f03e6b-6f12-44c3-9fa2-e08288bca17d req-8a538126-043b-4595-a544-06f54e77b69f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c8f03e6b-6f12-44c3-9fa2-e08288bca17d req-8a538126-043b-4595-a544-06f54e77b69f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c8f03e6b-6f12-44c3-9fa2-e08288bca17d req-8a538126-043b-4595-a544-06f54e77b69f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-c8f03e6b-6f12-44c3-9fa2-e08288bca17d req-8a538126-043b-4595-a544-06f54e77b69f service nova] Creating event network-vif-plugged:e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d for instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc on user Apr 14 04:29:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-c8f03e6b-6f12-44c3-9fa2-e08288bca17d req-8a538126-043b-4595-a544-06f54e77b69f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033739 Apr 14 04:29:54 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 233/695] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0cb7f905-a060-417b-a70c-9b80cd1276d9 req-189b1b7d-8ce5-49dd-8351-b4fb684f23c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a166de-f0c9-43f2-8c88-585e0d5d22cc", "name": "network-vif-plugged", "status": "completed", "tag": "e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:29:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0cb7f905-a060-417b-a70c-9b80cd1276d9 req-189b1b7d-8ce5-49dd-8351-b4fb684f23c2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0cb7f905-a060-417b-a70c-9b80cd1276d9 req-189b1b7d-8ce5-49dd-8351-b4fb684f23c2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0cb7f905-a060-417b-a70c-9b80cd1276d9 req-189b1b7d-8ce5-49dd-8351-b4fb684f23c2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0cb7f905-a060-417b-a70c-9b80cd1276d9 req-189b1b7d-8ce5-49dd-8351-b4fb684f23c2 service nova] Creating event network-vif-plugged:e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d for instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc on user Apr 14 04:29:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0cb7f905-a060-417b-a70c-9b80cd1276d9 req-189b1b7d-8ce5-49dd-8351-b4fb684f23c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039311 Apr 14 04:29:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 230/696] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:29:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:57 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:29:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-aaa432b9-9798-453c-bac8-7f7afb3a8d66 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 200 len: 1718 microversion: 2.1 time: 0.224295 Apr 14 04:29:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 234/697] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:29:57 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 1718 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:29:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:29:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a5a37bf1-b07e-44fd-9623-66151ca3509d tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048517 Apr 14 04:29:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 234/698] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:29:58 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61595) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 04:30:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d7bc4828-10f8-429f-a487-6a5151cf59c1 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71/action" status: 202 len: 0 microversion: 2.1 time: 0.249095 Apr 14 04:30:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 231/699] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:30:01 2023] POST /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:01 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:02 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-593af9b9-02f0-47be-a304-9f7b0c5cc218 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1509 microversion: 2.1 time: 0.260198 Apr 14 04:30:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 235/700] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:01 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1509 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] HTTP exception thrown: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Request method failure captured: Apr 14 04:30:05 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de HTTP/1.1 Apr 14 04:30:05 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:30:05 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:30:05 user devstack@n-api.service[61597]: Connection: close Apr 14 04:30:05 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:30:05 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:30:05 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:30:05 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:30:05 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOTubSjS5sIi3UL6E5TriLq9NWbcmbuKm2raUB3B9qm_DE8CfpRViYopxyH8fKXF8iKiWpis3b6dDPeKXx1vk-HE1xeBzJ3yt7Ns5cWILoPo382d9B4AKsPZ6uwTqIMEwSUPCULrVI2XEHHUc5D93cBVWFt7dlei6Hqzwr-e8O-aYY Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Project-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}] Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Tenant-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:05 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:05 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:05 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:30:05 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:30:05 user devstack@n-api.service[61597]: X-User-Id: 7610b45003e34f3395268977612f6c94 Apr 14 04:30:05 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:05 user devstack@n-api.service[61597]: method: > Apr 14 04:30:05 user devstack@n-api.service[61597]: exception: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:05 user devstack@n-api.service[61597]: action_args: {'id': 'e19eb131-ae90-4220-9d47-15e8b8b332de'} Apr 14 04:30:05 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:05 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Returning 404 to user: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:30:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-82e7262b-81a8-4e68-a1d3-a06f469def1c tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de" status: 404 len: 111 microversion: 2.1 time: 0.038098 Apr 14 04:30:05 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 235/701] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:05 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:30:05 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-5de211a0-cb3f-405c-89b5-fe502dc31b5b tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '.version_select at 0x7f538ac1fe20>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-5de211a0-cb3f-405c-89b5-fe502dc31b5b tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690869240" status: 202 len: 0 microversion: 2.1 time: 0.041602 Apr 14 04:30:05 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 232/702] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:30:05 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1690869240 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:30:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-20b63022-31d6-4c53-93d1-687d2a5fb8db tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Action: 'create', calling method: .version_select at 0x7f538b14f0a0>, body: {"keypair": {"name": "tempest-TestStampPattern-1877604753", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPy10nG4Vr3ssb6R59u94cqlTShzxPhKC2bNuw8xGLQYLxJf5JqesyHfE6AT1NUBBqZ5yv5gwPvV4khi3Sx9VWvIr6XsmH3ZmGby83ZqN/gypVHL9c9HqBsp1SNADUtbzA=="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:08 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-20b63022-31d6-4c53-93d1-687d2a5fb8db tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Getting quotas for project 0e6175a4372245a4a57dca1f12f7f007. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:30:08 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-20b63022-31d6-4c53-93d1-687d2a5fb8db tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Getting quotas for user ebe3f41b95824cd78193d0bbe206a66b and project 0e6175a4372245a4a57dca1f12f7f007. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:30:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-20b63022-31d6-4c53-93d1-687d2a5fb8db tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.210384 Apr 14 04:30:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 236/703] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:30:08 2023] POST /compute/v2.1/os-keypairs => generated 395 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-530656870", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1877604753", "security_groups": [{"name": "tempest-secgroup-smoke-516189218"}], "networks": [{"uuid": "1ba7d569-454d-4c89-80be-245f8ed0b1f9"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:12 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] validate_networks() for [('1ba7d569-454d-4c89-80be-245f8ed0b1f9', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-4bea416e-2765-449e-ba96-418c1fd35b22 req-18b17bd9-c785-40d8-bcea-57e8cb7600c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4bea416e-2765-449e-ba96-418c1fd35b22 req-18b17bd9-c785-40d8-bcea-57e8cb7600c2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4bea416e-2765-449e-ba96-418c1fd35b22 req-18b17bd9-c785-40d8-bcea-57e8cb7600c2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4bea416e-2765-449e-ba96-418c1fd35b22 req-18b17bd9-c785-40d8-bcea-57e8cb7600c2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-4bea416e-2765-449e-ba96-418c1fd35b22 req-18b17bd9-c785-40d8-bcea-57e8cb7600c2 service nova] Creating event network-changed:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:30:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-4bea416e-2765-449e-ba96-418c1fd35b22 req-18b17bd9-c785-40d8-bcea-57e8cb7600c2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045024 Apr 14 04:30:13 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 233/704] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:13 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=20 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] HTTP exception thrown: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Request method failure captured: Apr 14 04:30:13 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de HTTP/1.1 Apr 14 04:30:13 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:30:13 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:30:13 user devstack@n-api.service[61596]: Connection: close Apr 14 04:30:13 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:30:13 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:30:13 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:30:13 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:30:13 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOTubSjS5sIi3UL6E5TriLq9NWbcmbuKm2raUB3B9qm_DE8CfpRViYopxyH8fKXF8iKiWpis3b6dDPeKXx1vk-HE1xeBzJ3yt7Ns5cWILoPo382d9B4AKsPZ6uwTqIMEwSUPCULrVI2XEHHUc5D93cBVWFt7dlei6Hqzwr-e8O-aYY Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Project-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}] Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Tenant-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:13 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:13 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:13 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:30:13 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:30:13 user devstack@n-api.service[61596]: X-User-Id: 7610b45003e34f3395268977612f6c94 Apr 14 04:30:13 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:13 user devstack@n-api.service[61596]: method: > Apr 14 04:30:13 user devstack@n-api.service[61596]: exception: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61596]: action_args: {'id': 'e19eb131-ae90-4220-9d47-15e8b8b332de'} Apr 14 04:30:13 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Returning 404 to user: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:30:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a8d9e299-cefa-4db6-a584-db4d56d02fcd tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de" status: 404 len: 111 microversion: 2.1 time: 0.037127 Apr 14 04:30:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 237/705] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:30:13 2023] DELETE /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: e19eb131-ae90-4220-9d47-15e8b8b332de] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] HTTP exception thrown: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Request method failure captured: Apr 14 04:30:13 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de HTTP/1.1 Apr 14 04:30:13 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:30:13 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:30:13 user devstack@n-api.service[61595]: Connection: close Apr 14 04:30:13 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:30:13 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:30:13 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:30:13 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:30:13 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOTubSjS5sIi3UL6E5TriLq9NWbcmbuKm2raUB3B9qm_DE8CfpRViYopxyH8fKXF8iKiWpis3b6dDPeKXx1vk-HE1xeBzJ3yt7Ns5cWILoPo382d9B4AKsPZ6uwTqIMEwSUPCULrVI2XEHHUc5D93cBVWFt7dlei6Hqzwr-e8O-aYY Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Project-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}] Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Tenant-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:13 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:13 user devstack@n-api.service[61595]: X-User: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:13 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:30:13 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:30:13 user devstack@n-api.service[61595]: X-User-Id: 7610b45003e34f3395268977612f6c94 Apr 14 04:30:13 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:13 user devstack@n-api.service[61595]: method: > Apr 14 04:30:13 user devstack@n-api.service[61595]: exception: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61595]: action_args: {'id': 'e19eb131-ae90-4220-9d47-15e8b8b332de'} Apr 14 04:30:13 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. Apr 14 04:30:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:30:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Returning 404 to user: Instance e19eb131-ae90-4220-9d47-15e8b8b332de could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:30:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0aedc425-3f6b-4965-901e-e2c2cfd5cdf1 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de" status: 404 len: 111 microversion: 2.1 time: 0.038232 Apr 14 04:30:13 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 234/706] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:13 2023] GET /compute/v2.1/servers/e19eb131-ae90-4220-9d47-15e8b8b332de => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Getting quotas for project 0e6175a4372245a4a57dca1f12f7f007. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Getting quotas for user ebe3f41b95824cd78193d0bbe206a66b and project 0e6175a4372245a4a57dca1f12f7f007. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:30:13 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:30:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4fd080a2-e60e-41fe-8298-1ddc66beeef1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.694168 Apr 14 04:30:13 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 236/707] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:30:12 2023] POST /compute/v2.1/servers => generated 403 bytes in 696 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4711e1b6-2928-4a24-ba16-89305637a33a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4711e1b6-2928-4a24-ba16-89305637a33a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:13 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-4711e1b6-2928-4a24-ba16-89305637a33a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4711e1b6-2928-4a24-ba16-89305637a33a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5" status: 200 len: 1236 microversion: 2.1 time: 0.138969 Apr 14 04:30:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 238/708] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:13 2023] GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5 => generated 1236 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:30:16 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-28ff2545-2826-44db-b207-dbd2ef460127 req-c7e5d033-6c94-4864-9e51-8d6f77eba970 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-28ff2545-2826-44db-b207-dbd2ef460127 req-c7e5d033-6c94-4864-9e51-8d6f77eba970 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-28ff2545-2826-44db-b207-dbd2ef460127 req-c7e5d033-6c94-4864-9e51-8d6f77eba970 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-28ff2545-2826-44db-b207-dbd2ef460127 req-c7e5d033-6c94-4864-9e51-8d6f77eba970 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-28ff2545-2826-44db-b207-dbd2ef460127 req-c7e5d033-6c94-4864-9e51-8d6f77eba970 service nova] Creating event network-changed:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:30:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-28ff2545-2826-44db-b207-dbd2ef460127 req-c7e5d033-6c94-4864-9e51-8d6f77eba970 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032435 Apr 14 04:30:16 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 235/709] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:16 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] HTTP exception thrown: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Request method failure captured: Apr 14 04:30:16 user devstack@n-api.service[61597]: request: DELETE /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f HTTP/1.1 Apr 14 04:30:16 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:30:16 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:30:16 user devstack@n-api.service[61597]: Connection: close Apr 14 04:30:16 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:30:16 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:30:16 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:30:16 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:30:16 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOTubSjS5sIi3UL6E5TriLq9NWbcmbuKm2raUB3B9qm_DE8CfpRViYopxyH8fKXF8iKiWpis3b6dDPeKXx1vk-HE1xeBzJ3yt7Ns5cWILoPo382d9B4AKsPZ6uwTqIMEwSUPCULrVI2XEHHUc5D93cBVWFt7dlei6Hqzwr-e8O-aYY Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Project-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}] Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Tenant-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:16 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:16 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:16 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:30:16 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:30:16 user devstack@n-api.service[61597]: X-User-Id: 7610b45003e34f3395268977612f6c94 Apr 14 04:30:16 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:16 user devstack@n-api.service[61597]: method: > Apr 14 04:30:16 user devstack@n-api.service[61597]: exception: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61597]: action_args: {'id': 'da3b4651-aaa0-430d-85b8-c15de386d08f'} Apr 14 04:30:16 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Returning 404 to user: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:30:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0ee1d479-6913-4d4a-986f-2dc664b33610 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 404 len: 111 microversion: 2.1 time: 0.043888 Apr 14 04:30:16 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 237/710] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:30:16 2023] DELETE /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] [instance: da3b4651-aaa0-430d-85b8-c15de386d08f] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] HTTP exception thrown: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Request method failure captured: Apr 14 04:30:16 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f HTTP/1.1 Apr 14 04:30:16 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:30:16 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:30:16 user devstack@n-api.service[61596]: Connection: close Apr 14 04:30:16 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:30:16 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:30:16 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:30:16 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:30:16 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOTubSjS5sIi3UL6E5TriLq9NWbcmbuKm2raUB3B9qm_DE8CfpRViYopxyH8fKXF8iKiWpis3b6dDPeKXx1vk-HE1xeBzJ3yt7Ns5cWILoPo382d9B4AKsPZ6uwTqIMEwSUPCULrVI2XEHHUc5D93cBVWFt7dlei6Hqzwr-e8O-aYY Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Project-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/6a89255339f74e55ad7c92967558bb81"}]}] Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Tenant-Id: 6a89255339f74e55ad7c92967558bb81 Apr 14 04:30:16 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeTestJSON-991906288 Apr 14 04:30:16 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:16 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:30:16 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:30:16 user devstack@n-api.service[61596]: X-User-Id: 7610b45003e34f3395268977612f6c94 Apr 14 04:30:16 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeTestJSON-991906288-project-member Apr 14 04:30:16 user devstack@n-api.service[61596]: method: > Apr 14 04:30:16 user devstack@n-api.service[61596]: exception: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61596]: action_args: {'id': 'da3b4651-aaa0-430d-85b8-c15de386d08f'} Apr 14 04:30:16 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. Apr 14 04:30:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:30:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] Returning 404 to user: Instance da3b4651-aaa0-430d-85b8-c15de386d08f could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:30:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e0dfee1f-d6a3-4097-be67-5cad905af233 tempest-AttachVolumeTestJSON-991906288 tempest-AttachVolumeTestJSON-991906288-project-member] 10.0.0.210 "GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f" status: 404 len: 111 microversion: 2.1 time: 0.039646 Apr 14 04:30:16 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 239/711] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:16 2023] GET /compute/v2.1/servers/da3b4651-aaa0-430d-85b8-c15de386d08f => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:30:17 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-b8e326c8-b850-41a6-b287-00d6aa537ba6 req-10a8926c-d145-4765-a617-4df8d85ffe98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-plugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b8e326c8-b850-41a6-b287-00d6aa537ba6 req-10a8926c-d145-4765-a617-4df8d85ffe98 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b8e326c8-b850-41a6-b287-00d6aa537ba6 req-10a8926c-d145-4765-a617-4df8d85ffe98 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b8e326c8-b850-41a6-b287-00d6aa537ba6 req-10a8926c-d145-4765-a617-4df8d85ffe98 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-b8e326c8-b850-41a6-b287-00d6aa537ba6 req-10a8926c-d145-4765-a617-4df8d85ffe98 service nova] Creating event network-vif-plugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:30:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-b8e326c8-b850-41a6-b287-00d6aa537ba6 req-10a8926c-d145-4765-a617-4df8d85ffe98 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073964 Apr 14 04:30:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 236/712] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:30:17 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-15c2efab-5cec-4e77-99ec-7c35a91c11f8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 204 len: 0 microversion: 2.1 time: 0.209389 Apr 14 04:30:17 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 238/713] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:30:17 2023] DELETE /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 0 bytes in 211 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:17 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4eb19398-3c61-4a12-9ec0-be7b6e9afdd8 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 200 len: 1727 microversion: 2.1 time: 0.218255 Apr 14 04:30:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 240/714] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:17 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 1727 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:30:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-2a9ba507-3241-4423-9237-1c93993654e6 req-53917924-b1f8-4bcc-88cd-5e3c3ac8c27c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-unplugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2a9ba507-3241-4423-9237-1c93993654e6 req-53917924-b1f8-4bcc-88cd-5e3c3ac8c27c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2a9ba507-3241-4423-9237-1c93993654e6 req-53917924-b1f8-4bcc-88cd-5e3c3ac8c27c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2a9ba507-3241-4423-9237-1c93993654e6 req-53917924-b1f8-4bcc-88cd-5e3c3ac8c27c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2a9ba507-3241-4423-9237-1c93993654e6 req-53917924-b1f8-4bcc-88cd-5e3c3ac8c27c service nova] Creating event network-vif-unplugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:30:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-2a9ba507-3241-4423-9237-1c93993654e6 req-53917924-b1f8-4bcc-88cd-5e3c3ac8c27c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.048184 Apr 14 04:30:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 237/715] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:18 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:19 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f7d2e9ad-a20f-4b49-b593-82c62a8ab68e req-41860fc3-a0e6-443b-801d-3a223e41cb47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-plugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:19 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f7d2e9ad-a20f-4b49-b593-82c62a8ab68e req-41860fc3-a0e6-443b-801d-3a223e41cb47 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f7d2e9ad-a20f-4b49-b593-82c62a8ab68e req-41860fc3-a0e6-443b-801d-3a223e41cb47 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f7d2e9ad-a20f-4b49-b593-82c62a8ab68e req-41860fc3-a0e6-443b-801d-3a223e41cb47 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:19 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f7d2e9ad-a20f-4b49-b593-82c62a8ab68e req-41860fc3-a0e6-443b-801d-3a223e41cb47 service nova] Creating event network-vif-plugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:30:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f7d2e9ad-a20f-4b49-b593-82c62a8ab68e req-41860fc3-a0e6-443b-801d-3a223e41cb47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048901 Apr 14 04:30:19 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 239/716] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-plugged", "status": "completed", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}, {"server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "name": "network-vif-plugged", "status": "completed", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}, {"server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "name": "network-vif-plugged", "status": "completed", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] Creating event network-vif-plugged:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:30:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] Creating event network-vif-plugged:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:30:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] Creating event network-vif-plugged:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:30:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1d505c86-80a9-48de-92b0-89aab7d553a0 req-479a42d4-1623-4f0e-a4af-79001696148e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.055210 Apr 14 04:30:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 241/717] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:20 2023] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:21 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-685f5623-6fbb-4ae0-b751-ae26e796fa31 req-282d6289-4552-4d96-83b4-daf019c77bd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0a20aeb-ed06-4c65-b87d-74f8f825457d", "name": "network-vif-deleted", "tag": "3a3e3b13-7b4e-46c8-9123-5c1f121a38b9"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:21 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-685f5623-6fbb-4ae0-b751-ae26e796fa31 req-282d6289-4552-4d96-83b4-daf019c77bd7 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-685f5623-6fbb-4ae0-b751-ae26e796fa31 req-282d6289-4552-4d96-83b4-daf019c77bd7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-685f5623-6fbb-4ae0-b751-ae26e796fa31 req-282d6289-4552-4d96-83b4-daf019c77bd7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-806a2ff0-6a39-4b1f-8bd6-d381f1a8034d req-c49b38ba-db3a-475a-a279-899e5bc79700 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-685f5623-6fbb-4ae0-b751-ae26e796fa31 req-282d6289-4552-4d96-83b4-daf019c77bd7 service nova] Creating event network-vif-deleted:3a3e3b13-7b4e-46c8-9123-5c1f121a38b9 for instance a0a20aeb-ed06-4c65-b87d-74f8f825457d on user Apr 14 04:30:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-685f5623-6fbb-4ae0-b751-ae26e796fa31 req-282d6289-4552-4d96-83b4-daf019c77bd7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054485 Apr 14 04:30:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 238/718] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:21 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-806a2ff0-6a39-4b1f-8bd6-d381f1a8034d req-c49b38ba-db3a-475a-a279-899e5bc79700 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-806a2ff0-6a39-4b1f-8bd6-d381f1a8034d req-c49b38ba-db3a-475a-a279-899e5bc79700 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-806a2ff0-6a39-4b1f-8bd6-d381f1a8034d req-c49b38ba-db3a-475a-a279-899e5bc79700 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-806a2ff0-6a39-4b1f-8bd6-d381f1a8034d req-c49b38ba-db3a-475a-a279-899e5bc79700 service nova] Creating event network-changed:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:30:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-806a2ff0-6a39-4b1f-8bd6-d381f1a8034d req-c49b38ba-db3a-475a-a279-899e5bc79700 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075680 Apr 14 04:30:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 240/719] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:24 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:30:24 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-bf7c465d-12d1-4a96-8f27-013e390c772c tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066" status: 204 len: 0 microversion: 2.1 time: 0.172740 Apr 14 04:30:24 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 242/720] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:30:24 2023] DELETE /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:24 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0d3c1b814ec240279646878fd090f5f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39731dbb51484eff890a74b07241ba75', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:24 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2232c8b2-1a99-4283-a6c3-1fc559372e92 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066" status: 200 len: 1573 microversion: 2.1 time: 0.276616 Apr 14 04:30:24 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 239/721] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:24 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066 => generated 1573 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:30:24 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:24 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:24 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-0d146742-488c-4e26-acc1-9fd58cefe2f3 req-55777f89-1ef1-446a-96b9-249c91d06a4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "name": "network-vif-unplugged", "status": "completed", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0d146742-488c-4e26-acc1-9fd58cefe2f3 req-55777f89-1ef1-446a-96b9-249c91d06a4c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0d146742-488c-4e26-acc1-9fd58cefe2f3 req-55777f89-1ef1-446a-96b9-249c91d06a4c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:24 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0d146742-488c-4e26-acc1-9fd58cefe2f3 req-55777f89-1ef1-446a-96b9-249c91d06a4c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:24 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-0d146742-488c-4e26-acc1-9fd58cefe2f3 req-55777f89-1ef1-446a-96b9-249c91d06a4c service nova] Creating event network-vif-unplugged:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:30:24 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-0d146742-488c-4e26-acc1-9fd58cefe2f3 req-55777f89-1ef1-446a-96b9-249c91d06a4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.111494 Apr 14 04:30:24 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 241/722] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:24 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:26 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-38032d3e-dad7-4155-ab22-32b57f7e7339 req-f56e164b-ce20-426a-b76b-1636022f5328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "name": "network-vif-deleted", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-38032d3e-dad7-4155-ab22-32b57f7e7339 req-f56e164b-ce20-426a-b76b-1636022f5328 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-38032d3e-dad7-4155-ab22-32b57f7e7339 req-f56e164b-ce20-426a-b76b-1636022f5328 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:26 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-38032d3e-dad7-4155-ab22-32b57f7e7339 req-f56e164b-ce20-426a-b76b-1636022f5328 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-38032d3e-dad7-4155-ab22-32b57f7e7339 req-f56e164b-ce20-426a-b76b-1636022f5328 service nova] Creating event network-vif-deleted:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:30:26 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-38032d3e-dad7-4155-ab22-32b57f7e7339 req-f56e164b-ce20-426a-b76b-1636022f5328 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035982 Apr 14 04:30:26 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 243/723] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:26 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-19b7fdfc-080c-46bd-bdcc-cd7ebdd39e74 req-87d301d8-ab7f-460e-8165-45d98d623769 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f593ceb0-de44-490b-b365-3a05a3acd066", "name": "network-vif-plugged", "status": "completed", "tag": "dd12687e-ca27-4fba-9653-4fa1af3608a8"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-19b7fdfc-080c-46bd-bdcc-cd7ebdd39e74 req-87d301d8-ab7f-460e-8165-45d98d623769 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-19b7fdfc-080c-46bd-bdcc-cd7ebdd39e74 req-87d301d8-ab7f-460e-8165-45d98d623769 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-19b7fdfc-080c-46bd-bdcc-cd7ebdd39e74 req-87d301d8-ab7f-460e-8165-45d98d623769 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:26 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-19b7fdfc-080c-46bd-bdcc-cd7ebdd39e74 req-87d301d8-ab7f-460e-8165-45d98d623769 service nova] Creating event network-vif-plugged:dd12687e-ca27-4fba-9653-4fa1af3608a8 for instance f593ceb0-de44-490b-b365-3a05a3acd066 on user Apr 14 04:30:26 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-19b7fdfc-080c-46bd-bdcc-cd7ebdd39e74 req-87d301d8-ab7f-460e-8165-45d98d623769 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035872 Apr 14 04:30:26 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 240/724] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=5 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=5 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:39 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-47a0ad54-786f-47aa-947f-adb7a66e4bfa tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc" status: 200 len: 1690 microversion: 2.87 time: 0.210158 Apr 14 04:30:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 242/725] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:30:39 2023] GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc => generated 1690 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:45 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:45 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1e5b086b-7e14-4401-a155-8e88c0686cf6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 200 len: 1392 microversion: 2.1 time: 0.160374 Apr 14 04:30:45 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 244/726] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:45 2023] GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 1392 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestVolumeBootPatternsnapshot-706995129"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=5 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=20 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:45 user devstack@n-api.service[61595]: INFO nova.compute.api [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Attempting to quiesce instance before volume snapshot. Apr 14 04:30:45 user devstack@n-api.service[61595]: INFO nova.compute.api [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Skipping quiescing instance: QEMU guest agent is not enabled. Apr 14 04:30:45 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Creating snapshot from volume 300999d2-cadf-4299-8a05-85dec6b7d895. {{(pid=61595) snapshot_instance /opt/stack/nova/nova/compute/api.py:3511}} Apr 14 04:30:48 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-556dc318-d161-4e2c-adad-05ad970cbcf7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e/action" status: 202 len: 0 microversion: 2.1 time: 2.522728 Apr 14 04:30:48 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 241/727] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:30:45 2023] POST /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e/action => generated 0 bytes in 2524 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-image-snapshot-server-453223105", "imageRef": "37c9a7e6-d203-4290-ba7e-602fdff12012", "flavorRef": "42", "networks": [{"uuid": "e20e0d94-3b17-4872-b774-3a724d3a253b"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] validate_networks() for [('e20e0d94-3b17-4872-b774-3a724d3a253b', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for user bcf79de7da27495dbfd14c556b5b54c7 and project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:30:49 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name='/dev/vda',device_type='disk',disk_bus='virtio',encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id='f5cc0b68-6502-4a55-96a0-69a8f27c433c',source_type='snapshot',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:30:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-c1c3b813-732c-43ca-93eb-102f507975fb tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.589900 Apr 14 04:30:49 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 243/728] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:30:49 2023] POST /compute/v2.1/servers => generated 378 bytes in 592 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:30:49 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-571ab61b-10dd-4366-aed4-5a67186603a3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:49 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-571ab61b-10dd-4366-aed4-5a67186603a3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:49 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-571ab61b-10dd-4366-aed4-5a67186603a3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:49 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-571ab61b-10dd-4366-aed4-5a67186603a3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 200 len: 1223 microversion: 2.1 time: 0.075881 Apr 14 04:30:49 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 245/729] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:49 2023] GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 1223 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:52 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:30:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-84a77c3e-a4e6-47c0-aef6-ca8860986719 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1554 microversion: 2.1 time: 0.270918 Apr 14 04:30:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 242/730] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:30:52 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:30:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-c2e63357-6e4e-4076-a724-e694c9a40e39 req-1570cef3-0fcc-40d1-b614-fa6b38e88aee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca085872-69ff-41e4-be13-ffaa9a7cca82", "tag": "f010668b-3ce4-4f88-a116-dd9a67663985"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c2e63357-6e4e-4076-a724-e694c9a40e39 req-1570cef3-0fcc-40d1-b614-fa6b38e88aee service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c2e63357-6e4e-4076-a724-e694c9a40e39 req-1570cef3-0fcc-40d1-b614-fa6b38e88aee service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c2e63357-6e4e-4076-a724-e694c9a40e39 req-1570cef3-0fcc-40d1-b614-fa6b38e88aee service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-c2e63357-6e4e-4076-a724-e694c9a40e39 req-1570cef3-0fcc-40d1-b614-fa6b38e88aee service nova] Creating event network-changed:f010668b-3ce4-4f88-a116-dd9a67663985 for instance ca085872-69ff-41e4-be13-ffaa9a7cca82 on user Apr 14 04:30:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-c2e63357-6e4e-4076-a724-e694c9a40e39 req-1570cef3-0fcc-40d1-b614-fa6b38e88aee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043572 Apr 14 04:30:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 244/731] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-9612685c-ac74-404a-9c70-05b5aff438aa tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.112617 Apr 14 04:30:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 246/732] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:30:57 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-interface => generated 283 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-43ea00a8-a8c5-4ea9-a2a3-68e3458162f4 req-e9701895-09ed-4669-af84-d0a85ee7115a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:30:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-43ea00a8-a8c5-4ea9-a2a3-68e3458162f4 req-e9701895-09ed-4669-af84-d0a85ee7115a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-43ea00a8-a8c5-4ea9-a2a3-68e3458162f4 req-e9701895-09ed-4669-af84-d0a85ee7115a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-43ea00a8-a8c5-4ea9-a2a3-68e3458162f4 req-e9701895-09ed-4669-af84-d0a85ee7115a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-43ea00a8-a8c5-4ea9-a2a3-68e3458162f4 req-e9701895-09ed-4669-af84-d0a85ee7115a service nova] Creating event network-changed:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:30:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-43ea00a8-a8c5-4ea9-a2a3-68e3458162f4 req-e9701895-09ed-4669-af84-d0a85ee7115a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063415 Apr 14 04:30:58 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 243/733] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:30:58 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:59 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lazy-loading 'services' on Instance uuid cab84e5c-99ba-4e61-bf68-0a02b31ded5c {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:30:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-71f502c4-224b-46fa-a25f-17ec0650a7df tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments/2ea04249-09da-471f-a8b5-89a901381329" status: 202 len: 0 microversion: 2.1 time: 0.176873 Apr 14 04:30:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 245/734] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:30:59 2023] DELETE /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments/2ea04249-09da-471f-a8b5-89a901381329 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:30:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:30:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1b2a465c-008e-494c-bbba-ef8110029f24 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069994 Apr 14 04:30:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 247/735] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:30:59 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-748fac49-d90f-4cfc-bb95-30c26aad413d req-61e74250-fe57-433b-bc21-a5ac64bc493d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-748fac49-d90f-4cfc-bb95-30c26aad413d req-61e74250-fe57-433b-bc21-a5ac64bc493d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-748fac49-d90f-4cfc-bb95-30c26aad413d req-61e74250-fe57-433b-bc21-a5ac64bc493d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-748fac49-d90f-4cfc-bb95-30c26aad413d req-61e74250-fe57-433b-bc21-a5ac64bc493d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-748fac49-d90f-4cfc-bb95-30c26aad413d req-61e74250-fe57-433b-bc21-a5ac64bc493d service nova] Creating event network-changed:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:31:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-748fac49-d90f-4cfc-bb95-30c26aad413d req-61e74250-fe57-433b-bc21-a5ac64bc493d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036192 Apr 14 04:31:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 244/736] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:03 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:03 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-30d0d18c-3916-42e7-a61b-9fb1cf03894a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5" status: 200 len: 1537 microversion: 2.1 time: 0.198066 Apr 14 04:31:03 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 246/737] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:03 2023] GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5 => generated 1537 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:31:04 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6b938bf4-d7b6-4280-b0ed-924c7ec901d8 req-df3f7498-8358-46bc-958d-68f87925f400 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca085872-69ff-41e4-be13-ffaa9a7cca82", "name": "network-vif-plugged", "status": "completed", "tag": "f010668b-3ce4-4f88-a116-dd9a67663985"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:04 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6b938bf4-d7b6-4280-b0ed-924c7ec901d8 req-df3f7498-8358-46bc-958d-68f87925f400 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6b938bf4-d7b6-4280-b0ed-924c7ec901d8 req-df3f7498-8358-46bc-958d-68f87925f400 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6b938bf4-d7b6-4280-b0ed-924c7ec901d8 req-df3f7498-8358-46bc-958d-68f87925f400 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6b938bf4-d7b6-4280-b0ed-924c7ec901d8 req-df3f7498-8358-46bc-958d-68f87925f400 service nova] Creating event network-vif-plugged:f010668b-3ce4-4f88-a116-dd9a67663985 for instance ca085872-69ff-41e4-be13-ffaa9a7cca82 on user Apr 14 04:31:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6b938bf4-d7b6-4280-b0ed-924c7ec901d8 req-df3f7498-8358-46bc-958d-68f87925f400 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030787 Apr 14 04:31:04 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 248/738] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-e029e86f-5df3-4150-a861-0cbcc8d921d7 req-e75457a2-fdbc-45d4-b07d-20bf6bd0e81e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca085872-69ff-41e4-be13-ffaa9a7cca82", "name": "network-vif-plugged", "status": "completed", "tag": "f010668b-3ce4-4f88-a116-dd9a67663985"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e029e86f-5df3-4150-a861-0cbcc8d921d7 req-e75457a2-fdbc-45d4-b07d-20bf6bd0e81e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e029e86f-5df3-4150-a861-0cbcc8d921d7 req-e75457a2-fdbc-45d4-b07d-20bf6bd0e81e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e029e86f-5df3-4150-a861-0cbcc8d921d7 req-e75457a2-fdbc-45d4-b07d-20bf6bd0e81e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e029e86f-5df3-4150-a861-0cbcc8d921d7 req-e75457a2-fdbc-45d4-b07d-20bf6bd0e81e service nova] Creating event network-vif-plugged:f010668b-3ce4-4f88-a116-dd9a67663985 for instance ca085872-69ff-41e4-be13-ffaa9a7cca82 on user Apr 14 04:31:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-e029e86f-5df3-4150-a861-0cbcc8d921d7 req-e75457a2-fdbc-45d4-b07d-20bf6bd0e81e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034512 Apr 14 04:31:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 245/739] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:31:08 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d HTTP/1.1 Apr 14 04:31:08 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:31:08 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:31:08 user devstack@n-api.service[61597]: Connection: close Apr 14 04:31:08 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:31:08 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:31:08 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:31:08 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:31:08 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:31:08 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61597]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:31:08 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:31:08 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:31:08 user devstack@n-api.service[61597]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:31:08 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:31:08 user devstack@n-api.service[61597]: method: > Apr 14 04:31:08 user devstack@n-api.service[61597]: exception: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61597]: action_args: {'id': 'a0a20aeb-ed06-4c65-b87d-74f8f825457d'} Apr 14 04:31:08 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:31:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2c0e3443-f5b2-4f14-9631-93c46546f002 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 404 len: 111 microversion: 2.1 time: 0.048428 Apr 14 04:31:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 247/740] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:08 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:31:08 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments HTTP/1.1 Apr 14 04:31:08 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:31:08 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:31:08 user devstack@n-api.service[61596]: Connection: close Apr 14 04:31:08 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:31:08 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:31:08 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:31:08 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:31:08 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:31:08 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61596]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:31:08 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:31:08 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:31:08 user devstack@n-api.service[61596]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:31:08 user devstack@n-api.service[61596]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:31:08 user devstack@n-api.service[61596]: method: > Apr 14 04:31:08 user devstack@n-api.service[61596]: exception: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61596]: action_args: {'server_id': 'a0a20aeb-ed06-4c65-b87d-74f8f825457d'} Apr 14 04:31:08 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:31:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3525d287-3ca9-4d75-a678-3728cc52ee38 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.031932 Apr 14 04:31:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 249/741] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:31:08 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d/os-volume_attachments => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:31:08 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d HTTP/1.1 Apr 14 04:31:08 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:31:08 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:31:08 user devstack@n-api.service[61595]: Connection: close Apr 14 04:31:08 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:31:08 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:31:08 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:31:08 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:31:08 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:31:08 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:31:08 user devstack@n-api.service[61595]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:31:08 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:31:08 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:31:08 user devstack@n-api.service[61595]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:31:08 user devstack@n-api.service[61595]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:31:08 user devstack@n-api.service[61595]: method: > Apr 14 04:31:08 user devstack@n-api.service[61595]: exception: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61595]: action_args: {'id': 'a0a20aeb-ed06-4c65-b87d-74f8f825457d'} Apr 14 04:31:08 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:31:08 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:31:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:31:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b7b80153-8198-4ead-ba60-528c3c29a638 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 404 len: 111 microversion: 2.1 time: 0.044540 Apr 14 04:31:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 246/742] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:08 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-496557296", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "2fe4c44a-0ec3-4df5-a079-ae920ed93fe7"}], "security_groups": [{"name": "tempest-securitygroup--47068274"}], "key_name": "tempest-keypair-964114001", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] validate_networks() for [('2fe4c44a-0ec3-4df5-a079-ae920ed93fe7', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for user e35b3ae371cf4dd4b21e2999e58cd2f4 and project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:31:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:31:09 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-bebd9aa3-87e4-411e-af3c-ad0fe137f50e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.636801 Apr 14 04:31:09 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 248/743] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:31:08 2023] POST /compute/v2.1/servers => generated 402 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:31:09 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ff1afa5d-389e-4d32-90a0-af2b8bf02917 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:09 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ff1afa5d-389e-4d32-90a0-af2b8bf02917 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:09 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-ff1afa5d-389e-4d32-90a0-af2b8bf02917 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:09 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ff1afa5d-389e-4d32-90a0-af2b8bf02917 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c" status: 200 len: 1231 microversion: 2.1 time: 0.117368 Apr 14 04:31:09 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 250/744] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:09 2023] GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c => generated 1231 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:31:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-25761e43-cb69-4c40-bc44-d67644af0713 req-7fd7bb17-8cbb-453c-b460-0e2d91340c7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-25761e43-cb69-4c40-bc44-d67644af0713 req-7fd7bb17-8cbb-453c-b460-0e2d91340c7e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-25761e43-cb69-4c40-bc44-d67644af0713 req-7fd7bb17-8cbb-453c-b460-0e2d91340c7e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-25761e43-cb69-4c40-bc44-d67644af0713 req-7fd7bb17-8cbb-453c-b460-0e2d91340c7e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-25761e43-cb69-4c40-bc44-d67644af0713 req-7fd7bb17-8cbb-453c-b460-0e2d91340c7e service nova] Creating event network-changed:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:31:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-25761e43-cb69-4c40-bc44-d67644af0713 req-7fd7bb17-8cbb-453c-b460-0e2d91340c7e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036886 Apr 14 04:31:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 247/745] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-160bd61e-1d3c-42ff-bac2-2cf95dc60ca6 req-6d9c9b77-cbf0-4e23-a1ca-fbb45fc5eb83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "name": "network-vif-plugged", "status": "completed", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:14 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-160bd61e-1d3c-42ff-bac2-2cf95dc60ca6 req-6d9c9b77-cbf0-4e23-a1ca-fbb45fc5eb83 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-160bd61e-1d3c-42ff-bac2-2cf95dc60ca6 req-6d9c9b77-cbf0-4e23-a1ca-fbb45fc5eb83 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-160bd61e-1d3c-42ff-bac2-2cf95dc60ca6 req-6d9c9b77-cbf0-4e23-a1ca-fbb45fc5eb83 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-160bd61e-1d3c-42ff-bac2-2cf95dc60ca6 req-6d9c9b77-cbf0-4e23-a1ca-fbb45fc5eb83 service nova] Creating event network-vif-plugged:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:31:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-160bd61e-1d3c-42ff-bac2-2cf95dc60ca6 req-6d9c9b77-cbf0-4e23-a1ca-fbb45fc5eb83 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057755 Apr 14 04:31:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 249/746] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] [instance: f593ceb0-de44-490b-b365-3a05a3acd066] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:14 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] HTTP exception thrown: Instance f593ceb0-de44-490b-b365-3a05a3acd066 could not be found. Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Request method failure captured: Apr 14 04:31:14 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066 HTTP/1.1 Apr 14 04:31:14 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:31:14 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:31:14 user devstack@n-api.service[61596]: Connection: close Apr 14 04:31:14 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:31:14 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:31:14 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:31:14 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:31:14 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONVDh7xSW_p0nzGjuQ3lZcPytW8ZyPr9K9LE7OkjemYNIcjAKwKzkK_mmgRN1uZTnTvt0twka8crhYJdFSimiGLjyL51ASk0OYbLXuSU_YNYyq0TtTynXXeVA0PhZ3o1Mzgn0DRGMd3kaC-VDDqYp5FVFRotnk6wrDgcCAK9MEm7wnI Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Project-Id: 39731dbb51484eff890a74b07241ba75 Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Project-Name: tempest-SnapshotDataIntegrityTests-502963555 Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/39731dbb51484eff890a74b07241ba75"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39731dbb51484eff890a74b07241ba75"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/39731dbb51484eff890a74b07241ba75"}]}] Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Tenant: tempest-SnapshotDataIntegrityTests-502963555 Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Tenant-Id: 39731dbb51484eff890a74b07241ba75 Apr 14 04:31:14 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-SnapshotDataIntegrityTests-502963555 Apr 14 04:31:14 user devstack@n-api.service[61596]: X-User: tempest-SnapshotDataIntegrityTests-502963555-project-member Apr 14 04:31:14 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:31:14 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:31:14 user devstack@n-api.service[61596]: X-User-Id: 0d3c1b814ec240279646878fd090f5f2 Apr 14 04:31:14 user devstack@n-api.service[61596]: X-User-Name: tempest-SnapshotDataIntegrityTests-502963555-project-member Apr 14 04:31:14 user devstack@n-api.service[61596]: method: > Apr 14 04:31:14 user devstack@n-api.service[61596]: exception: Instance f593ceb0-de44-490b-b365-3a05a3acd066 could not be found. Apr 14 04:31:14 user devstack@n-api.service[61596]: action_args: {'id': 'f593ceb0-de44-490b-b365-3a05a3acd066'} Apr 14 04:31:14 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f593ceb0-de44-490b-b365-3a05a3acd066 could not be found. Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f593ceb0-de44-490b-b365-3a05a3acd066 could not be found. Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f593ceb0-de44-490b-b365-3a05a3acd066 could not be found. Apr 14 04:31:14 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:31:14 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Returning 404 to user: Instance f593ceb0-de44-490b-b365-3a05a3acd066 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:31:14 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-64fe3793-9e8b-4bfc-8e1a-dbdb2df7640a tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066" status: 404 len: 111 microversion: 2.1 time: 0.032034 Apr 14 04:31:14 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 251/747] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:14 2023] GET /compute/v2.1/servers/f593ceb0-de44-490b-b365-3a05a3acd066 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 04:31:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b276be78-2a6a-454d-aa06-d190146fcde2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] Calling method '.version_select at 0x7f538ac6f760>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b276be78-2a6a-454d-aa06-d190146fcde2 tempest-SnapshotDataIntegrityTests-502963555 tempest-SnapshotDataIntegrityTests-502963555-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-881844326" status: 202 len: 0 microversion: 2.1 time: 0.036132 Apr 14 04:31:14 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 248/748] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:31:14 2023] DELETE /compute/v2.1/os-keypairs/tempest-SnapshotDataIntegrityTests-881844326 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:31:16 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-1e94a9f6-45f6-416a-b819-da953f72c09e req-f6ffa2f2-07be-43cd-a76e-002cad2a0bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "name": "network-vif-plugged", "status": "completed", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1e94a9f6-45f6-416a-b819-da953f72c09e req-f6ffa2f2-07be-43cd-a76e-002cad2a0bb5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1e94a9f6-45f6-416a-b819-da953f72c09e req-f6ffa2f2-07be-43cd-a76e-002cad2a0bb5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:16 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1e94a9f6-45f6-416a-b819-da953f72c09e req-f6ffa2f2-07be-43cd-a76e-002cad2a0bb5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-1e94a9f6-45f6-416a-b819-da953f72c09e req-f6ffa2f2-07be-43cd-a76e-002cad2a0bb5 service nova] Creating event network-vif-plugged:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:31:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-1e94a9f6-45f6-416a-b819-da953f72c09e req-f6ffa2f2-07be-43cd-a76e-002cad2a0bb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040493 Apr 14 04:31:16 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 250/749] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-ServerBootFromVolumeStableRescueTest-image-807918877"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=20 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=16 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=30,nova_cell1:INSERT=2,nova_cell1:UPDATE=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=17,nova_api:DELETE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:40 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d7795644-e961-4f7e-bd0c-917a6b39d02c tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 200 len: 1550 microversion: 2.1 time: 0.319704 Apr 14 04:31:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 249/750] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:40 2023] GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 1550 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:31:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5aad4665-ec1e-4238-a3a4-3c6604bc67cc tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc/action" status: 202 len: 52 microversion: 2.87 time: 0.991078 Apr 14 04:31:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 252/751] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:31:39 2023] POST /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc/action => generated 52 bytes in 992 msecs (HTTP/1.1 202) 9 headers in 364 bytes (1 switches on core 0) Apr 14 04:31:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:46 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=27,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:47 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-51e849bc-f275-47dc-9db8-5253c55a87b9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc" status: 200 len: 1690 microversion: 2.87 time: 0.281274 Apr 14 04:31:47 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 251/752] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:31:46 2023] GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc => generated 1690 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:49 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-35971253-7a53-4582-9b7d-e6830426ba98 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044788 Apr 14 04:31:49 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 250/753] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:31:49 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:49 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:31:49 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4e3655cf-0dc2-437c-97d2-06802994d8e8 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 204 len: 0 microversion: 2.1 time: 0.132017 Apr 14 04:31:49 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 253/754] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:31:49 2023] DELETE /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:49 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-7167600c-eaeb-4f73-b3f9-d32bd3b9b5e9 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 200 len: 1678 microversion: 2.1 time: 0.158039 Apr 14 04:31:49 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 252/755] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:49 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0ee389a6-7de4-4e3d-9ced-c4b3026c9625 req-fef296fe-19b4-4811-bce5-19882f3bb3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-unplugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ee389a6-7de4-4e3d-9ced-c4b3026c9625 req-fef296fe-19b4-4811-bce5-19882f3bb3d1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ee389a6-7de4-4e3d-9ced-c4b3026c9625 req-fef296fe-19b4-4811-bce5-19882f3bb3d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ee389a6-7de4-4e3d-9ced-c4b3026c9625 req-fef296fe-19b4-4811-bce5-19882f3bb3d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:49 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0ee389a6-7de4-4e3d-9ced-c4b3026c9625 req-fef296fe-19b4-4811-bce5-19882f3bb3d1 service nova] Creating event network-vif-unplugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:31:49 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0ee389a6-7de4-4e3d-9ced-c4b3026c9625 req-fef296fe-19b4-4811-bce5-19882f3bb3d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029058 Apr 14 04:31:49 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 251/756] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:49 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:51 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-a47af9b4-966f-41e0-a006-5af5ae324937 req-9f32bbfe-43d5-43ad-b327-243b2250f487 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-deleted", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a47af9b4-966f-41e0-a006-5af5ae324937 req-9f32bbfe-43d5-43ad-b327-243b2250f487 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a47af9b4-966f-41e0-a006-5af5ae324937 req-9f32bbfe-43d5-43ad-b327-243b2250f487 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:51 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a47af9b4-966f-41e0-a006-5af5ae324937 req-9f32bbfe-43d5-43ad-b327-243b2250f487 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:51 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-a47af9b4-966f-41e0-a006-5af5ae324937 req-9f32bbfe-43d5-43ad-b327-243b2250f487 service nova] Creating event network-vif-deleted:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:31:51 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-a47af9b4-966f-41e0-a006-5af5ae324937 req-9f32bbfe-43d5-43ad-b327-243b2250f487 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033960 Apr 14 04:31:51 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 254/757] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:51 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-36552ad5-f688-470e-8c47-f88f45d9297e req-fd02f248-fcc9-4194-b359-a4f3941ac4b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cab84e5c-99ba-4e61-bf68-0a02b31ded5c", "name": "network-vif-plugged", "status": "completed", "tag": "e3868733-d538-4469-9a3e-c02014ec9066"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-36552ad5-f688-470e-8c47-f88f45d9297e req-fd02f248-fcc9-4194-b359-a4f3941ac4b5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-36552ad5-f688-470e-8c47-f88f45d9297e req-fd02f248-fcc9-4194-b359-a4f3941ac4b5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-36552ad5-f688-470e-8c47-f88f45d9297e req-fd02f248-fcc9-4194-b359-a4f3941ac4b5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-36552ad5-f688-470e-8c47-f88f45d9297e req-fd02f248-fcc9-4194-b359-a4f3941ac4b5 service nova] Creating event network-vif-plugged:e3868733-d538-4469-9a3e-c02014ec9066 for instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c on user Apr 14 04:31:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-36552ad5-f688-470e-8c47-f88f45d9297e req-fd02f248-fcc9-4194-b359-a4f3941ac4b5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059480 Apr 14 04:31:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 253/758] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:52 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-f2d14f0d-50aa-473d-919f-180a9b91b9b2 req-cebdc234-eb17-47ae-9d86-419e1328a794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f2d14f0d-50aa-473d-919f-180a9b91b9b2 req-cebdc234-eb17-47ae-9d86-419e1328a794 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f2d14f0d-50aa-473d-919f-180a9b91b9b2 req-cebdc234-eb17-47ae-9d86-419e1328a794 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f2d14f0d-50aa-473d-919f-180a9b91b9b2 req-cebdc234-eb17-47ae-9d86-419e1328a794 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-f2d14f0d-50aa-473d-919f-180a9b91b9b2 req-cebdc234-eb17-47ae-9d86-419e1328a794 service nova] Creating event network-changed:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:31:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:31:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-f2d14f0d-50aa-473d-919f-180a9b91b9b2 req-cebdc234-eb17-47ae-9d86-419e1328a794 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029606 Apr 14 04:31:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 255/759] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-33a6dd15-0f49-4e3b-91a5-dbe3b02439ba tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 204 len: 0 microversion: 2.1 time: 0.116677 Apr 14 04:31:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 252/760] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:31:53 2023] DELETE /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:53 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '36b6981092424de781e8403946f956d3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b0e15d3d3e0943c4b6bd54abf2de5fee', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-c3fb4492-97a2-4899-b6ad-0c8c5e024057 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 200 len: 1560 microversion: 2.1 time: 0.297288 Apr 14 04:31:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 254/761] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:53 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 1560 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:31:55 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-cbaf2caf-0331-4dba-bd4d-e411c16d9c1a req-0c996982-098d-4018-9f58-1072c678d6b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-deleted", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cbaf2caf-0331-4dba-bd4d-e411c16d9c1a req-0c996982-098d-4018-9f58-1072c678d6b4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cbaf2caf-0331-4dba-bd4d-e411c16d9c1a req-0c996982-098d-4018-9f58-1072c678d6b4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-cbaf2caf-0331-4dba-bd4d-e411c16d9c1a req-0c996982-098d-4018-9f58-1072c678d6b4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-cbaf2caf-0331-4dba-bd4d-e411c16d9c1a req-0c996982-098d-4018-9f58-1072c678d6b4 service nova] Creating event network-vif-deleted:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:31:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-cdb17712-4845-4cbd-b0c5-2b8976deafc3 req-abfa80d6-7bea-4485-92a5-017e028e9c1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-unplugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}, {"server_uuid": "6a510dd3-bb77-4f6d-bdfd-180ce1d31c71", "name": "network-vif-plugged", "status": "completed", "tag": "61ec63cd-2733-40c4-a8c6-9243a6a3c144"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:31:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-cbaf2caf-0331-4dba-bd4d-e411c16d9c1a req-0c996982-098d-4018-9f58-1072c678d6b4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040538 Apr 14 04:31:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 256/762] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cdb17712-4845-4cbd-b0c5-2b8976deafc3 req-abfa80d6-7bea-4485-92a5-017e028e9c1f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cdb17712-4845-4cbd-b0c5-2b8976deafc3 req-abfa80d6-7bea-4485-92a5-017e028e9c1f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cdb17712-4845-4cbd-b0c5-2b8976deafc3 req-abfa80d6-7bea-4485-92a5-017e028e9c1f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-cdb17712-4845-4cbd-b0c5-2b8976deafc3 req-abfa80d6-7bea-4485-92a5-017e028e9c1f service nova] Creating event network-vif-unplugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:31:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-cdb17712-4845-4cbd-b0c5-2b8976deafc3 req-abfa80d6-7bea-4485-92a5-017e028e9c1f service nova] Creating event network-vif-plugged:61ec63cd-2733-40c4-a8c6-9243a6a3c144 for instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 on user Apr 14 04:31:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-cdb17712-4845-4cbd-b0c5-2b8976deafc3 req-abfa80d6-7bea-4485-92a5-017e028e9c1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.033485 Apr 14 04:31:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 253/763] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:31:55 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:31:59 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:31:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-c3f6faa3-b774-42ff-b5ae-495db1b0762a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c" status: 200 len: 1537 microversion: 2.1 time: 0.186146 Apr 14 04:31:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 255/764] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:31:59 2023] GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c => generated 1537 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:04 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:32:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-ff4d65b2-3f14-4077-a6db-c403f7736b60 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5" status: 200 len: 1537 microversion: 2.1 time: 0.252593 Apr 14 04:32:04 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 257/765] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:32:03 2023] GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5 => generated 1537 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:32:06 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:06 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-891ec3a3-76ab-4cef-849e-43326a7aa983 req-8c049063-b60e-450b-bca0-04bf5dbccbcc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-891ec3a3-76ab-4cef-849e-43326a7aa983 req-8c049063-b60e-450b-bca0-04bf5dbccbcc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-891ec3a3-76ab-4cef-849e-43326a7aa983 req-8c049063-b60e-450b-bca0-04bf5dbccbcc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-891ec3a3-76ab-4cef-849e-43326a7aa983 req-8c049063-b60e-450b-bca0-04bf5dbccbcc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-891ec3a3-76ab-4cef-849e-43326a7aa983 req-8c049063-b60e-450b-bca0-04bf5dbccbcc service nova] Creating event network-changed:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:32:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-891ec3a3-76ab-4cef-849e-43326a7aa983 req-8c049063-b60e-450b-bca0-04bf5dbccbcc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093775 Apr 14 04:32:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 254/766] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:06 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cd931337-f058-4d2e-bb9b-21d50e96a28b"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d0850cc3-8eee-447c-8f6e-79920a1b6d34 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "POST /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.277594 Apr 14 04:32:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 256/767] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:32:06 2023] POST /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments => generated 194 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=17,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:17 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lazy-loading 'services' on Instance uuid 390ca845-5660-49d0-bd8a-fcfc39176ca5 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:32:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f486042f-23ac-4de7-afce-a9f775a4ebe7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments/cd931337-f058-4d2e-bb9b-21d50e96a28b" status: 202 len: 0 microversion: 2.1 time: 0.272303 Apr 14 04:32:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 258/768] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:32:17 2023] DELETE /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments/cd931337-f058-4d2e-bb9b-21d50e96a28b => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1cf45207-242f-4a99-b0a0-444aa1ca9fe9 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054518 Apr 14 04:32:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 255/769] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:32:17 2023] GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=14 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=37,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: cab84e5c-99ba-4e61-bf68-0a02b31ded5c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] HTTP exception thrown: Instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c could not be found. Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Request method failure captured: Apr 14 04:32:39 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c HTTP/1.1 Apr 14 04:32:39 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:32:39 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:32:39 user devstack@n-api.service[61597]: Connection: close Apr 14 04:32:39 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:32:39 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:32:39 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:32:39 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:32:39 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOmH01Hutb9YRw7uP2OlEp2aln8h5oMlw6e03I64C0rdRlcywArRqsgHVh8sCAN_UYylqj-A4cprpWb6TM90dGEKDnyOXHJIuIWR9Q1QhB-vCRVDiHxb9uvmuCKQGukmWIvHvqEv-t6izPrze6I7q7h7D4ZERz8pfCORUpGc7P915g Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Project-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}] Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Tenant-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:32:39 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:32:39 user devstack@n-api.service[61597]: X-User: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:32:39 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:32:39 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:32:39 user devstack@n-api.service[61597]: X-User-Id: 5234914aec8e443b8a38ac6b38729031 Apr 14 04:32:39 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:32:39 user devstack@n-api.service[61597]: method: > Apr 14 04:32:39 user devstack@n-api.service[61597]: exception: Instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c could not be found. Apr 14 04:32:39 user devstack@n-api.service[61597]: action_args: {'id': 'cab84e5c-99ba-4e61-bf68-0a02b31ded5c'} Apr 14 04:32:39 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c could not be found. Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c could not be found. Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c could not be found. Apr 14 04:32:39 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:32:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Returning 404 to user: Instance cab84e5c-99ba-4e61-bf68-0a02b31ded5c could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:32:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-47b08330-840b-471a-9d1a-cbd21285a91e tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c" status: 404 len: 111 microversion: 2.1 time: 0.038979 Apr 14 04:32:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 257/770] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:32:39 2023] GET /compute/v2.1/servers/cab84e5c-99ba-4e61-bf68-0a02b31ded5c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:32:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2a58a3de-7d71-4176-abe9-bdb84d9a9671 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '.version_select at 0x7f538ab6d750>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2a58a3de-7d71-4176-abe9-bdb84d9a9671 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320453961" status: 202 len: 0 microversion: 2.1 time: 0.042175 Apr 14 04:32:39 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 259/771] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:32:39 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1320453961 => generated 0 bytes in 44 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:40 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:32:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-68cb2523-8691-4cd2-8b63-3916b1761233 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 200 len: 1550 microversion: 2.1 time: 0.182600 Apr 14 04:32:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 256/772] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:32:40 2023] GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 1550 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:32:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a5bf3f94-86f7-4753-aa3d-ccd0f94df8e2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 204 len: 0 microversion: 2.1 time: 0.140979 Apr 14 04:32:40 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 258/773] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:32:40 2023] DELETE /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:32:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-83c42b2b-aab6-4755-b3b8-d22dd82652e9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 200 len: 1556 microversion: 2.1 time: 0.180380 Apr 14 04:32:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 260/774] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:32:40 2023] GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 1556 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:32:41 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0f9287f1-daa6-4737-aa40-e41303e77a30 req-b3ae44a7-1a71-4f65-be0b-b8ceef4356a9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca085872-69ff-41e4-be13-ffaa9a7cca82", "name": "network-vif-unplugged", "status": "completed", "tag": "f010668b-3ce4-4f88-a116-dd9a67663985"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0f9287f1-daa6-4737-aa40-e41303e77a30 req-b3ae44a7-1a71-4f65-be0b-b8ceef4356a9 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0f9287f1-daa6-4737-aa40-e41303e77a30 req-b3ae44a7-1a71-4f65-be0b-b8ceef4356a9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0f9287f1-daa6-4737-aa40-e41303e77a30 req-b3ae44a7-1a71-4f65-be0b-b8ceef4356a9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0f9287f1-daa6-4737-aa40-e41303e77a30 req-b3ae44a7-1a71-4f65-be0b-b8ceef4356a9 service nova] Creating event network-vif-unplugged:f010668b-3ce4-4f88-a116-dd9a67663985 for instance ca085872-69ff-41e4-be13-ffaa9a7cca82 on user Apr 14 04:32:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0f9287f1-daa6-4737-aa40-e41303e77a30 req-b3ae44a7-1a71-4f65-be0b-b8ceef4356a9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.187796 Apr 14 04:32:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 257/775] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:43 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-99e560d8-1386-471f-a965-86cf81705835 req-5000da55-fce5-4afa-a058-5c47dc124480 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca085872-69ff-41e4-be13-ffaa9a7cca82", "name": "network-vif-deleted", "tag": "f010668b-3ce4-4f88-a116-dd9a67663985"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-99e560d8-1386-471f-a965-86cf81705835 req-5000da55-fce5-4afa-a058-5c47dc124480 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-99e560d8-1386-471f-a965-86cf81705835 req-5000da55-fce5-4afa-a058-5c47dc124480 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:43 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-99e560d8-1386-471f-a965-86cf81705835 req-5000da55-fce5-4afa-a058-5c47dc124480 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:43 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-99e560d8-1386-471f-a965-86cf81705835 req-5000da55-fce5-4afa-a058-5c47dc124480 service nova] Creating event network-vif-deleted:f010668b-3ce4-4f88-a116-dd9a67663985 for instance ca085872-69ff-41e4-be13-ffaa9a7cca82 on user Apr 14 04:32:43 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-99e560d8-1386-471f-a965-86cf81705835 req-5000da55-fce5-4afa-a058-5c47dc124480 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041587 Apr 14 04:32:43 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 259/776] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-073140f6-30fa-4b08-8614-21570d88cc76 req-b08f7523-16db-4bbc-8da5-4e3beac936fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca085872-69ff-41e4-be13-ffaa9a7cca82", "name": "network-vif-plugged", "status": "completed", "tag": "f010668b-3ce4-4f88-a116-dd9a67663985"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-073140f6-30fa-4b08-8614-21570d88cc76 req-b08f7523-16db-4bbc-8da5-4e3beac936fc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-073140f6-30fa-4b08-8614-21570d88cc76 req-b08f7523-16db-4bbc-8da5-4e3beac936fc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-073140f6-30fa-4b08-8614-21570d88cc76 req-b08f7523-16db-4bbc-8da5-4e3beac936fc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-073140f6-30fa-4b08-8614-21570d88cc76 req-b08f7523-16db-4bbc-8da5-4e3beac936fc service nova] Creating event network-vif-plugged:f010668b-3ce4-4f88-a116-dd9a67663985 for instance ca085872-69ff-41e4-be13-ffaa9a7cca82 on user Apr 14 04:32:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-073140f6-30fa-4b08-8614-21570d88cc76 req-b08f7523-16db-4bbc-8da5-4e3beac936fc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031176 Apr 14 04:32:43 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 261/777] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] [instance: 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] HTTP exception thrown: Instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 could not be found. Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Request method failure captured: Apr 14 04:32:43 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 HTTP/1.1 Apr 14 04:32:43 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:32:43 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:32:43 user devstack@n-api.service[61595]: Connection: close Apr 14 04:32:43 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:32:43 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:32:43 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:32:43 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:32:43 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONXVg6_q4gpH6o3U-fct-wCS8-dyoPn4bNBbxb46bGcvjFEBsEutVGZb7_KX1OCrPvBSycvGzft8B2pwmFxg5ftiEPGeF9me7MfPFZQLPvUz1s4_3-WRqgFC8AgHjkSnePTK34C9UGaHDC8Lp4Pj65l8zH1i035wOw41HKF3RMzQ3Dc Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Project-Id: b0e15d3d3e0943c4b6bd54abf2de5fee Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestShelveInstance-1458140851 Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/b0e15d3d3e0943c4b6bd54abf2de5fee"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0e15d3d3e0943c4b6bd54abf2de5fee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/b0e15d3d3e0943c4b6bd54abf2de5fee"}]}] Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Tenant: tempest-TestShelveInstance-1458140851 Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Tenant-Id: b0e15d3d3e0943c4b6bd54abf2de5fee Apr 14 04:32:43 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestShelveInstance-1458140851 Apr 14 04:32:43 user devstack@n-api.service[61595]: X-User: tempest-TestShelveInstance-1458140851-project-member Apr 14 04:32:43 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:32:43 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:32:43 user devstack@n-api.service[61595]: X-User-Id: 36b6981092424de781e8403946f956d3 Apr 14 04:32:43 user devstack@n-api.service[61595]: X-User-Name: tempest-TestShelveInstance-1458140851-project-member Apr 14 04:32:43 user devstack@n-api.service[61595]: method: > Apr 14 04:32:43 user devstack@n-api.service[61595]: exception: Instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 could not be found. Apr 14 04:32:43 user devstack@n-api.service[61595]: action_args: {'id': '6a510dd3-bb77-4f6d-bdfd-180ce1d31c71'} Apr 14 04:32:43 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 could not be found. Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 could not be found. Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 could not be found. Apr 14 04:32:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:32:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Returning 404 to user: Instance 6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:32:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-76c8dfc4-9212-4644-804f-a35e3aaacc46 tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71" status: 404 len: 111 microversion: 2.1 time: 0.041147 Apr 14 04:32:43 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 258/778] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:32:43 2023] GET /compute/v2.1/servers/6a510dd3-bb77-4f6d-bdfd-180ce1d31c71 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:32:44 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ceb8dfd6-554b-4972-a301-853b438134fa tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] Calling method '.version_select at 0x7f538abb8af0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:44 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ceb8dfd6-554b-4972-a301-853b438134fa tempest-TestShelveInstance-1458140851 tempest-TestShelveInstance-1458140851-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2060150193" status: 202 len: 0 microversion: 2.1 time: 0.027592 Apr 14 04:32:44 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 260/779] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 04:32:44 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2060150193 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:47 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:32:47 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-57d65ad2-01be-4dc0-ac75-56d90ccf0e32 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a" status: 204 len: 0 microversion: 2.1 time: 0.175778 Apr 14 04:32:47 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 262/780] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:32:47 2023] DELETE /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:47 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerBootFromVolumeStableRescueTest-server-1167245313", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "block_device_mapping_v2": [{"boot_index": "0", "source_type": "image", "volume_size": 1, "uuid": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "destination_type": "volume"}], "networks": [{"uuid": "7457ae38-8cd9-4172-aa34-25b764436aee"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:47 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] validate_networks() for [('7457ae38-8cd9-4172-aa34-25b764436aee', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:32:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:32:48 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5e6a9a65-4c0f-489f-84a3-efdfd7ca41ad tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a" status: 200 len: 1496 microversion: 2.1 time: 0.379467 Apr 14 04:32:48 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 261/781] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:32:47 2023] GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a => generated 1496 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:32:48 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-4c7770dd-8bc0-46c1-9189-a2d279d32b82 req-2538c08a-235f-46d2-9d14-5a7518f10921 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-unplugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4c7770dd-8bc0-46c1-9189-a2d279d32b82 req-2538c08a-235f-46d2-9d14-5a7518f10921 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4c7770dd-8bc0-46c1-9189-a2d279d32b82 req-2538c08a-235f-46d2-9d14-5a7518f10921 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4c7770dd-8bc0-46c1-9189-a2d279d32b82 req-2538c08a-235f-46d2-9d14-5a7518f10921 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-4c7770dd-8bc0-46c1-9189-a2d279d32b82 req-2538c08a-235f-46d2-9d14-5a7518f10921 service nova] Creating event network-vif-unplugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:32:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-4c7770dd-8bc0-46c1-9189-a2d279d32b82 req-2538c08a-235f-46d2-9d14-5a7518f10921 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.188131 Apr 14 04:32:48 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 263/782] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:48 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Getting quotas for user 6ec7103e06e643a6b9b2c908ba8d7b06 and project d5995b934b0546c0983387e46e3b3df4. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:32:48 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=1,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:32:48 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-698c32a3-4a57-4bc4-9e50-b4aea652d7bf tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.87 time: 0.989539 Apr 14 04:32:48 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 259/783] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 04:32:47 2023] POST /compute/v2.1/servers => generated 378 bytes in 991 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:32:48 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9bb55bbd-e1ef-4761-aace-adb604081df3 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:48 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9bb55bbd-e1ef-4761-aace-adb604081df3 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-9bb55bbd-e1ef-4761-aace-adb604081df3 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:32:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-9bb55bbd-e1ef-4761-aace-adb604081df3 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:32:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-9bb55bbd-e1ef-4761-aace-adb604081df3 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:32:48 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9bb55bbd-e1ef-4761-aace-adb604081df3 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 200 len: 1395 microversion: 2.87 time: 0.166930 Apr 14 04:32:48 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 262/784] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:32:48 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 1395 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:32:49 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-befd56f6-b354-49d1-b42e-8b5765aa1123 req-a7d84113-db93-4d58-a632-4e81cc39e2f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-deleted", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-befd56f6-b354-49d1-b42e-8b5765aa1123 req-a7d84113-db93-4d58-a632-4e81cc39e2f5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-befd56f6-b354-49d1-b42e-8b5765aa1123 req-a7d84113-db93-4d58-a632-4e81cc39e2f5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:49 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-befd56f6-b354-49d1-b42e-8b5765aa1123 req-a7d84113-db93-4d58-a632-4e81cc39e2f5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:49 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-befd56f6-b354-49d1-b42e-8b5765aa1123 req-a7d84113-db93-4d58-a632-4e81cc39e2f5 service nova] Creating event network-vif-deleted:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:32:49 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-befd56f6-b354-49d1-b42e-8b5765aa1123 req-a7d84113-db93-4d58-a632-4e81cc39e2f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048241 Apr 14 04:32:49 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 264/785] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:49 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:50 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-99cfab93-4be6-40d8-b2bf-abe67eb86bb4 req-dac8ae25-866e-487d-a134-0963832e8cdf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2f7e20cd-33ef-4f83-bcdb-a13b9b51370a", "name": "network-vif-plugged", "status": "completed", "tag": "1201ab18-d7ef-4a92-a77e-d0ab69858538"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-99cfab93-4be6-40d8-b2bf-abe67eb86bb4 req-dac8ae25-866e-487d-a134-0963832e8cdf service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-99cfab93-4be6-40d8-b2bf-abe67eb86bb4 req-dac8ae25-866e-487d-a134-0963832e8cdf service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-99cfab93-4be6-40d8-b2bf-abe67eb86bb4 req-dac8ae25-866e-487d-a134-0963832e8cdf service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:50 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-99cfab93-4be6-40d8-b2bf-abe67eb86bb4 req-dac8ae25-866e-487d-a134-0963832e8cdf service nova] Creating event network-vif-plugged:1201ab18-d7ef-4a92-a77e-d0ab69858538 for instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a on user Apr 14 04:32:50 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-99cfab93-4be6-40d8-b2bf-abe67eb86bb4 req-dac8ae25-866e-487d-a134-0963832e8cdf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034518 Apr 14 04:32:50 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 260/786] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:50 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-ff31da45-c3aa-43fe-b52c-3c815dd7e7f4 req-21192af9-9d54-4393-91f5-dd46f7758b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:32:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ff31da45-c3aa-43fe-b52c-3c815dd7e7f4 req-21192af9-9d54-4393-91f5-dd46f7758b4c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ff31da45-c3aa-43fe-b52c-3c815dd7e7f4 req-21192af9-9d54-4393-91f5-dd46f7758b4c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ff31da45-c3aa-43fe-b52c-3c815dd7e7f4 req-21192af9-9d54-4393-91f5-dd46f7758b4c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-ff31da45-c3aa-43fe-b52c-3c815dd7e7f4 req-21192af9-9d54-4393-91f5-dd46f7758b4c service nova] Creating event network-changed:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:32:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-ff31da45-c3aa-43fe-b52c-3c815dd7e7f4 req-21192af9-9d54-4393-91f5-dd46f7758b4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029954 Apr 14 04:32:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 263/787] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:32:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=18,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:32:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:32:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a52cf733-e79c-4033-867d-09895a717b96 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.390980 Apr 14 04:32:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 265/788] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:32:59 2023] GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c/os-interface => generated 283 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=14 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-56a3dea8-baaa-47e2-a7ea-1d8a2282276b req-24492837-67cc-4b98-943c-fd513ca452d6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-56a3dea8-baaa-47e2-a7ea-1d8a2282276b req-24492837-67cc-4b98-943c-fd513ca452d6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-56a3dea8-baaa-47e2-a7ea-1d8a2282276b req-24492837-67cc-4b98-943c-fd513ca452d6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-56a3dea8-baaa-47e2-a7ea-1d8a2282276b req-24492837-67cc-4b98-943c-fd513ca452d6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-56a3dea8-baaa-47e2-a7ea-1d8a2282276b req-24492837-67cc-4b98-943c-fd513ca452d6 service nova] Creating event network-changed:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:33:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-56a3dea8-baaa-47e2-a7ea-1d8a2282276b req-24492837-67cc-4b98-943c-fd513ca452d6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044009 Apr 14 04:33:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 261/789] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:04 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:04 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=24,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:04 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:04 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a59271ec-f012-4533-847e-c4f2c622ca08 req-6018dd95-4580-4930-a28b-95b60d29a140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a59271ec-f012-4533-847e-c4f2c622ca08 req-6018dd95-4580-4930-a28b-95b60d29a140 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a59271ec-f012-4533-847e-c4f2c622ca08 req-6018dd95-4580-4930-a28b-95b60d29a140 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:04 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a59271ec-f012-4533-847e-c4f2c622ca08 req-6018dd95-4580-4930-a28b-95b60d29a140 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a59271ec-f012-4533-847e-c4f2c622ca08 req-6018dd95-4580-4930-a28b-95b60d29a140 service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:33:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a59271ec-f012-4533-847e-c4f2c622ca08 req-6018dd95-4580-4930-a28b-95b60d29a140 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041925 Apr 14 04:33:04 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 264/790] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:04 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerActionsTestJSON-server-372327292", "imageRef": "", "flavorRef": "42", "networks": [{"uuid": "2fe4c44a-0ec3-4df5-a079-ae920ed93fe7"}], "security_groups": [{"name": "tempest-securitygroup--47068274"}], "key_name": "tempest-keypair-964114001", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=", "block_device_mapping_v2": [{"uuid": "992a3f86-d313-4b1e-9491-3008be037269", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:04 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] validate_networks() for [('2fe4c44a-0ec3-4df5-a079-ae920ed93fe7', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for user e35b3ae371cf4dd4b21e2999e58cd2f4 and project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:33:05 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='992a3f86-d313-4b1e-9491-3008be037269',volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:33:05 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-62db2ca5-1eb7-4991-810b-64f604e00e3e tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.874603 Apr 14 04:33:05 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 266/791] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:33:04 2023] POST /compute/v2.1/servers => generated 402 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:33:05 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6431d720-9960-430f-9765-0831a47c8036 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:05 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-6431d720-9960-430f-9765-0831a47c8036 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:05 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-6431d720-9960-430f-9765-0831a47c8036 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:05 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6431d720-9960-430f-9765-0831a47c8036 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1074 microversion: 2.1 time: 0.065392 Apr 14 04:33:05 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 262/792] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:33:05 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1074 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:33:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-5d8d1670-0aea-49e8-a44d-553e6df06a97 req-7db0ff28-8631-4ff7-988c-973f37764cea service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5d8d1670-0aea-49e8-a44d-553e6df06a97 req-7db0ff28-8631-4ff7-988c-973f37764cea service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5d8d1670-0aea-49e8-a44d-553e6df06a97 req-7db0ff28-8631-4ff7-988c-973f37764cea service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5d8d1670-0aea-49e8-a44d-553e6df06a97 req-7db0ff28-8631-4ff7-988c-973f37764cea service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5d8d1670-0aea-49e8-a44d-553e6df06a97 req-7db0ff28-8631-4ff7-988c-973f37764cea service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:33:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-5d8d1670-0aea-49e8-a44d-553e6df06a97 req-7db0ff28-8631-4ff7-988c-973f37764cea service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034831 Apr 14 04:33:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 265/793] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7bae2def-4ba4-4284-8cff-4dcc323da65a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049595 Apr 14 04:33:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 267/794] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:33:07 2023] GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:33:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-43d799e7-f6bf-45f4-9df1-ef756b4c0fa3 req-22de7e60-8c79-41cd-b316-7542e21985f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-43d799e7-f6bf-45f4-9df1-ef756b4c0fa3 req-22de7e60-8c79-41cd-b316-7542e21985f7 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-43d799e7-f6bf-45f4-9df1-ef756b4c0fa3 req-22de7e60-8c79-41cd-b316-7542e21985f7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-43d799e7-f6bf-45f4-9df1-ef756b4c0fa3 req-22de7e60-8c79-41cd-b316-7542e21985f7 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-43d799e7-f6bf-45f4-9df1-ef756b4c0fa3 req-22de7e60-8c79-41cd-b316-7542e21985f7 service nova] Creating event network-changed:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:33:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-43d799e7-f6bf-45f4-9df1-ef756b4c0fa3 req-22de7e60-8c79-41cd-b316-7542e21985f7 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037019 Apr 14 04:33:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 263/795] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Action: 'action', calling method: >, body: {"createImage": {"name": "tempest-TestStampPatternsnapshot-153401794"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-6e135e9f-4154-4a19-8a68-db37eb18299d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "POST /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/action" status: 202 len: 0 microversion: 2.1 time: 0.873590 Apr 14 04:33:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 266/796] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:33:11 2023] POST /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/action => generated 0 bytes in 876 msecs (HTTP/1.1 202) 10 headers in 449 bytes (1 switches on core 0) Apr 14 04:33:15 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-5f3513d0-ad11-48fa-805e-f33c983a8461 req-017b7883-854c-4a39-b04a-7a14582e9f14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-plugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5f3513d0-ad11-48fa-805e-f33c983a8461 req-017b7883-854c-4a39-b04a-7a14582e9f14 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5f3513d0-ad11-48fa-805e-f33c983a8461 req-017b7883-854c-4a39-b04a-7a14582e9f14 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5f3513d0-ad11-48fa-805e-f33c983a8461 req-017b7883-854c-4a39-b04a-7a14582e9f14 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5f3513d0-ad11-48fa-805e-f33c983a8461 req-017b7883-854c-4a39-b04a-7a14582e9f14 service nova] Creating event network-vif-plugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:33:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-5f3513d0-ad11-48fa-805e-f33c983a8461 req-017b7883-854c-4a39-b04a-7a14582e9f14 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046834 Apr 14 04:33:15 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 268/797] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:15 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:17 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:17 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-9581b2e2-ec8a-48cf-a179-96b87a1d338e req-1ae82a6c-c867-4185-861e-bed03abf3dc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-plugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9581b2e2-ec8a-48cf-a179-96b87a1d338e req-1ae82a6c-c867-4185-861e-bed03abf3dc3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9581b2e2-ec8a-48cf-a179-96b87a1d338e req-1ae82a6c-c867-4185-861e-bed03abf3dc3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9581b2e2-ec8a-48cf-a179-96b87a1d338e req-1ae82a6c-c867-4185-861e-bed03abf3dc3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-9581b2e2-ec8a-48cf-a179-96b87a1d338e req-1ae82a6c-c867-4185-861e-bed03abf3dc3 service nova] Creating event network-vif-plugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:33:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-9581b2e2-ec8a-48cf-a179-96b87a1d338e req-1ae82a6c-c867-4185-861e-bed03abf3dc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036051 Apr 14 04:33:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 264/798] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:21 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestStampPattern-server-1660505126", "imageRef": "8666f9e6-ed56-46cf-a3bc-a12038eea805", "flavorRef": "42", "key_name": "tempest-TestStampPattern-1877604753", "security_groups": [{"name": "tempest-secgroup-smoke-516189218"}], "networks": [{"uuid": "1ba7d569-454d-4c89-80be-245f8ed0b1f9"}]}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] validate_networks() for [('1ba7d569-454d-4c89-80be-245f8ed0b1f9', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Getting quotas for project 0e6175a4372245a4a57dca1f12f7f007. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Getting quotas for user ebe3f41b95824cd78193d0bbe206a66b and project 0e6175a4372245a4a57dca1f12f7f007. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:33:22 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8666f9e6-ed56-46cf-a3bc-a12038eea805',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:33:22 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-1e2e9ae1-d3d8-4116-8256-281e04defca5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.593130 Apr 14 04:33:22 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 267/799] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:33:21 2023] POST /compute/v2.1/servers => generated 403 bytes in 598 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:33:22 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:22 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-489a5622-dba9-4f43-99a3-d3e8d3b32bd0 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:22 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-489a5622-dba9-4f43-99a3-d3e8d3b32bd0 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:22 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-489a5622-dba9-4f43-99a3-d3e8d3b32bd0 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-489a5622-dba9-4f43-99a3-d3e8d3b32bd0 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a" status: 200 len: 1237 microversion: 2.1 time: 0.074214 Apr 14 04:33:22 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 269/800] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:33:22 2023] GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a => generated 1237 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:33:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-c6a15206-2d32-4969-8942-16be03f22c6a req-aeaa3f0a-a48e-4296-97f2-a3cd4383da3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c6a15206-2d32-4969-8942-16be03f22c6a req-aeaa3f0a-a48e-4296-97f2-a3cd4383da3e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c6a15206-2d32-4969-8942-16be03f22c6a req-aeaa3f0a-a48e-4296-97f2-a3cd4383da3e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c6a15206-2d32-4969-8942-16be03f22c6a req-aeaa3f0a-a48e-4296-97f2-a3cd4383da3e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-c6a15206-2d32-4969-8942-16be03f22c6a req-aeaa3f0a-a48e-4296-97f2-a3cd4383da3e service nova] Creating event network-changed:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:33:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-c6a15206-2d32-4969-8942-16be03f22c6a req-aeaa3f0a-a48e-4296-97f2-a3cd4383da3e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040458 Apr 14 04:33:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 265/801] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:27 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-30573da4-2afa-4a61-aaa9-d6429fa3fb86 req-ba0c295d-d764-4ddc-a537-9be4fd9237cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "name": "network-vif-plugged", "status": "completed", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-30573da4-2afa-4a61-aaa9-d6429fa3fb86 req-ba0c295d-d764-4ddc-a537-9be4fd9237cb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-30573da4-2afa-4a61-aaa9-d6429fa3fb86 req-ba0c295d-d764-4ddc-a537-9be4fd9237cb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-30573da4-2afa-4a61-aaa9-d6429fa3fb86 req-ba0c295d-d764-4ddc-a537-9be4fd9237cb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-30573da4-2afa-4a61-aaa9-d6429fa3fb86 req-ba0c295d-d764-4ddc-a537-9be4fd9237cb service nova] Creating event network-vif-plugged:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:33:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-30573da4-2afa-4a61-aaa9-d6429fa3fb86 req-ba0c295d-d764-4ddc-a537-9be4fd9237cb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.399789 Apr 14 04:33:27 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 268/802] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:29 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=14 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:29 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-0aa5abd8-aa21-4163-b394-b458b374a26e req-5605d71a-befe-404f-ab3f-b0b841465f2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "name": "network-vif-plugged", "status": "completed", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:29 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0aa5abd8-aa21-4163-b394-b458b374a26e req-5605d71a-befe-404f-ab3f-b0b841465f2b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0aa5abd8-aa21-4163-b394-b458b374a26e req-5605d71a-befe-404f-ab3f-b0b841465f2b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:29 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0aa5abd8-aa21-4163-b394-b458b374a26e req-5605d71a-befe-404f-ab3f-b0b841465f2b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:29 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0aa5abd8-aa21-4163-b394-b458b374a26e req-5605d71a-befe-404f-ab3f-b0b841465f2b service nova] Creating event network-vif-plugged:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:33:29 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-0aa5abd8-aa21-4163-b394-b458b374a26e req-5605d71a-befe-404f-ab3f-b0b841465f2b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041072 Apr 14 04:33:29 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 270/803] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=13 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=9 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:33:31 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 HTTP/1.1 Apr 14 04:33:31 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:33:31 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:33:31 user devstack@n-api.service[61595]: Connection: close Apr 14 04:33:31 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:33:31 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:33:31 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:33:31 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:33:31 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:33:31 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:33:31 user devstack@n-api.service[61595]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:33:31 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:33:31 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:33:31 user devstack@n-api.service[61595]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:33:31 user devstack@n-api.service[61595]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:33:31 user devstack@n-api.service[61595]: method: > Apr 14 04:33:31 user devstack@n-api.service[61595]: exception: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:33:31 user devstack@n-api.service[61595]: action_args: {'id': 'ca085872-69ff-41e4-be13-ffaa9a7cca82'} Apr 14 04:33:31 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:33:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:33:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-fd9a4b7a-1e7f-4aa4-b1a7-6cf80611c261 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 404 len: 111 microversion: 2.1 time: 0.036553 Apr 14 04:33:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 266/804] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:33:31 2023] GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:34 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:33:34 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-885a1967-e3a5-4703-b8d4-3086631b0d12 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 204 len: 0 microversion: 2.1 time: 0.530512 Apr 14 04:33:34 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 269/805] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:33:34 2023] DELETE /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:35 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:35 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-780a3eda-030e-41f8-9892-4930922f427d tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 200 len: 1398 microversion: 2.1 time: 0.324835 Apr 14 04:33:35 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 271/806] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:33:34 2023] GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 1398 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:33:35 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-28bb7ed2-9ead-4393-9f65-b8638546b0f8 req-238a23f8-e1a8-4d08-baa5-0cc430e7f8a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7befec-3f77-4eb7-be53-d1b1e791713e", "name": "network-vif-unplugged", "status": "completed", "tag": "0b301be3-2fd0-4e29-9740-a2ce2193d477"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-28bb7ed2-9ead-4393-9f65-b8638546b0f8 req-238a23f8-e1a8-4d08-baa5-0cc430e7f8a6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-28bb7ed2-9ead-4393-9f65-b8638546b0f8 req-238a23f8-e1a8-4d08-baa5-0cc430e7f8a6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-28bb7ed2-9ead-4393-9f65-b8638546b0f8 req-238a23f8-e1a8-4d08-baa5-0cc430e7f8a6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:35 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-28bb7ed2-9ead-4393-9f65-b8638546b0f8 req-238a23f8-e1a8-4d08-baa5-0cc430e7f8a6 service nova] Creating event network-vif-unplugged:0b301be3-2fd0-4e29-9740-a2ce2193d477 for instance af7befec-3f77-4eb7-be53-d1b1e791713e on user Apr 14 04:33:35 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-28bb7ed2-9ead-4393-9f65-b8638546b0f8 req-238a23f8-e1a8-4d08-baa5-0cc430e7f8a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.039237 Apr 14 04:33:35 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 267/807] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:35 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:36 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-c4c5090c-80b9-467c-9fb5-5db6c6f578f5 req-7c17e9e0-e460-4cce-a986-c85c4a98dc47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7befec-3f77-4eb7-be53-d1b1e791713e", "name": "network-vif-deleted", "tag": "0b301be3-2fd0-4e29-9740-a2ce2193d477"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c4c5090c-80b9-467c-9fb5-5db6c6f578f5 req-7c17e9e0-e460-4cce-a986-c85c4a98dc47 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c4c5090c-80b9-467c-9fb5-5db6c6f578f5 req-7c17e9e0-e460-4cce-a986-c85c4a98dc47 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:36 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c4c5090c-80b9-467c-9fb5-5db6c6f578f5 req-7c17e9e0-e460-4cce-a986-c85c4a98dc47 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:36 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-c4c5090c-80b9-467c-9fb5-5db6c6f578f5 req-7c17e9e0-e460-4cce-a986-c85c4a98dc47 service nova] Creating event network-vif-deleted:0b301be3-2fd0-4e29-9740-a2ce2193d477 for instance af7befec-3f77-4eb7-be53-d1b1e791713e on user Apr 14 04:33:36 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-c4c5090c-80b9-467c-9fb5-5db6c6f578f5 req-7c17e9e0-e460-4cce-a986-c85c4a98dc47 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031368 Apr 14 04:33:36 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 270/808] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:36 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:37 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-a544d41c-3e1b-411d-af88-e122d22331a0 req-cce5f959-c4dd-4744-82de-fff584497451 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "af7befec-3f77-4eb7-be53-d1b1e791713e", "name": "network-vif-plugged", "status": "completed", "tag": "0b301be3-2fd0-4e29-9740-a2ce2193d477"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a544d41c-3e1b-411d-af88-e122d22331a0 req-cce5f959-c4dd-4744-82de-fff584497451 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a544d41c-3e1b-411d-af88-e122d22331a0 req-cce5f959-c4dd-4744-82de-fff584497451 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-a544d41c-3e1b-411d-af88-e122d22331a0 req-cce5f959-c4dd-4744-82de-fff584497451 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-a544d41c-3e1b-411d-af88-e122d22331a0 req-cce5f959-c4dd-4744-82de-fff584497451 service nova] Creating event network-vif-plugged:0b301be3-2fd0-4e29-9740-a2ce2193d477 for instance af7befec-3f77-4eb7-be53-d1b1e791713e on user Apr 14 04:33:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-a544d41c-3e1b-411d-af88-e122d22331a0 req-cce5f959-c4dd-4744-82de-fff584497451 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029393 Apr 14 04:33:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 272/809] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:37 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] HTTP exception thrown: Instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a could not be found. Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Request method failure captured: Apr 14 04:33:38 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a HTTP/1.1 Apr 14 04:33:38 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:33:38 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:33:38 user devstack@n-api.service[61595]: Connection: close Apr 14 04:33:38 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:33:38 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:33:38 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:33:38 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:33:38 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOmH01Hutb9YRw7uP2OlEp2aln8h5oMlw6e03I64C0rdRlcywArRqsgHVh8sCAN_UYylqj-A4cprpWb6TM90dGEKDnyOXHJIuIWR9Q1QhB-vCRVDiHxb9uvmuCKQGukmWIvHvqEv-t6izPrze6I7q7h7D4ZERz8pfCORUpGc7P915g Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Project-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}] Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Tenant-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:33:38 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:33:38 user devstack@n-api.service[61595]: X-User: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:33:38 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:33:38 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:33:38 user devstack@n-api.service[61595]: X-User-Id: 5234914aec8e443b8a38ac6b38729031 Apr 14 04:33:38 user devstack@n-api.service[61595]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:33:38 user devstack@n-api.service[61595]: method: > Apr 14 04:33:38 user devstack@n-api.service[61595]: exception: Instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a could not be found. Apr 14 04:33:38 user devstack@n-api.service[61595]: action_args: {'id': '2f7e20cd-33ef-4f83-bcdb-a13b9b51370a'} Apr 14 04:33:38 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a could not be found. Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a could not be found. Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a could not be found. Apr 14 04:33:38 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Returning 404 to user: Instance 2f7e20cd-33ef-4f83-bcdb-a13b9b51370a could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:33:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-dadc0560-15c9-46ce-8919-00d8135be702 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a" status: 404 len: 111 microversion: 2.1 time: 0.141507 Apr 14 04:33:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 268/810] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:33:38 2023] GET /compute/v2.1/servers/2f7e20cd-33ef-4f83-bcdb-a13b9b51370a => generated 111 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:33:38 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e39b4277-22aa-4219-b1dc-faf2726caec6 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 204 len: 0 microversion: 2.1 time: 0.125417 Apr 14 04:33:38 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 271/811] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:33:38 2023] DELETE /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5234914aec8e443b8a38ac6b38729031', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '33320dc2f2c14ecfa5abf6574029c36c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:38 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1185d77e-ed31-43ca-98d8-606c9e009d37 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 200 len: 1511 microversion: 2.1 time: 0.285056 Apr 14 04:33:38 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 273/812] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:33:38 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 1511 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-5dd94d81-6bd1-485e-9582-bfe2c90ef9e4 req-48260d59-3f81-43e8-a9ce-af61f422c87d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-unplugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5dd94d81-6bd1-485e-9582-bfe2c90ef9e4 req-48260d59-3f81-43e8-a9ce-af61f422c87d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5dd94d81-6bd1-485e-9582-bfe2c90ef9e4 req-48260d59-3f81-43e8-a9ce-af61f422c87d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5dd94d81-6bd1-485e-9582-bfe2c90ef9e4 req-48260d59-3f81-43e8-a9ce-af61f422c87d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5dd94d81-6bd1-485e-9582-bfe2c90ef9e4 req-48260d59-3f81-43e8-a9ce-af61f422c87d service nova] Creating event network-vif-unplugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:33:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-5dd94d81-6bd1-485e-9582-bfe2c90ef9e4 req-48260d59-3f81-43e8-a9ce-af61f422c87d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.027595 Apr 14 04:33:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 269/813] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:38 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:39 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:39 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:39 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0d7bd937-cf15-4509-bd94-847285041d2b tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 200 len: 1769 microversion: 2.87 time: 0.215035 Apr 14 04:33:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 272/814] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:33:38 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 1769 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Apr 14 04:33:40 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-0c092958-1d4c-46a8-9d1e-d0bff2b8a812 req-9791eec4-a225-4508-a088-727ffe7282fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-plugged", "status": "completed", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}, {"server_uuid": "586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc", "name": "network-vif-deleted", "tag": "593a3298-746a-48af-96dc-4c572e0d59c2"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:33:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0c092958-1d4c-46a8-9d1e-d0bff2b8a812 req-9791eec4-a225-4508-a088-727ffe7282fd service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0c092958-1d4c-46a8-9d1e-d0bff2b8a812 req-9791eec4-a225-4508-a088-727ffe7282fd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-0c092958-1d4c-46a8-9d1e-d0bff2b8a812 req-9791eec4-a225-4508-a088-727ffe7282fd service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0c092958-1d4c-46a8-9d1e-d0bff2b8a812 req-9791eec4-a225-4508-a088-727ffe7282fd service nova] Creating event network-vif-plugged:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:33:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-0c092958-1d4c-46a8-9d1e-d0bff2b8a812 req-9791eec4-a225-4508-a088-727ffe7282fd service nova] Creating event network-vif-deleted:593a3298-746a-48af-96dc-4c572e0d59c2 for instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc on user Apr 14 04:33:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-0c092958-1d4c-46a8-9d1e-d0bff2b8a812 req-9791eec4-a225-4508-a088-727ffe7282fd service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.031754 Apr 14 04:33:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 274/815] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:33:40 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=7 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=7 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:33:55 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:33:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-593853f7-9520-4957-9de2-1692316ad095 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1426 microversion: 2.1 time: 0.168335 Apr 14 04:33:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 270/816] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:33:55 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1426 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:12 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2fd32fcc-5f11-4e51-b958-aec94bc0fe12 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a" status: 200 len: 1539 microversion: 2.1 time: 0.212089 Apr 14 04:34:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 273/817] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:12 2023] GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a => generated 1539 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=9 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=18 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:34:25 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e HTTP/1.1 Apr 14 04:34:25 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:34:25 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:34:25 user devstack@n-api.service[61596]: Connection: close Apr 14 04:34:25 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:34:25 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:34:25 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:34:25 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:34:25 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61596]: method: > Apr 14 04:34:25 user devstack@n-api.service[61596]: exception: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: action_args: {'id': 'af7befec-3f77-4eb7-be53-d1b1e791713e'} Apr 14 04:34:25 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:34:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-8f543490-09fa-4b78-8908-e49e5dac76a5 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 404 len: 111 microversion: 2.1 time: 0.042435 Apr 14 04:34:25 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 275/818] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:25 2023] GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:34:25 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 HTTP/1.1 Apr 14 04:34:25 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:34:25 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:34:25 user devstack@n-api.service[61595]: Connection: close Apr 14 04:34:25 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:34:25 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:34:25 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:34:25 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:34:25 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61595]: method: > Apr 14 04:34:25 user devstack@n-api.service[61595]: exception: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: action_args: {'id': 'ca085872-69ff-41e4-be13-ffaa9a7cca82'} Apr 14 04:34:25 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:34:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-26ab67d0-6184-4e50-9a74-d982a8de2418 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 404 len: 111 microversion: 2.1 time: 0.033465 Apr 14 04:34:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 271/819] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:34:25 2023] DELETE /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: ca085872-69ff-41e4-be13-ffaa9a7cca82] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:34:25 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 HTTP/1.1 Apr 14 04:34:25 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:34:25 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:34:25 user devstack@n-api.service[61597]: Connection: close Apr 14 04:34:25 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:34:25 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:34:25 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:34:25 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:34:25 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61597]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61597]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:34:25 user devstack@n-api.service[61597]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61597]: method: > Apr 14 04:34:25 user devstack@n-api.service[61597]: exception: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61597]: action_args: {'id': 'ca085872-69ff-41e4-be13-ffaa9a7cca82'} Apr 14 04:34:25 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. Apr 14 04:34:25 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance ca085872-69ff-41e4-be13-ffaa9a7cca82 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:34:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-58c77e07-07e7-42ba-bf11-53bf65a6e856 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82" status: 404 len: 111 microversion: 2.1 time: 0.046274 Apr 14 04:34:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 274/820] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:25 2023] GET /compute/v2.1/servers/ca085872-69ff-41e4-be13-ffaa9a7cca82 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:34:25 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e HTTP/1.1 Apr 14 04:34:25 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:34:25 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:34:25 user devstack@n-api.service[61596]: Connection: close Apr 14 04:34:25 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:34:25 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:34:25 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:34:25 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:34:25 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:34:25 user devstack@n-api.service[61596]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61596]: method: > Apr 14 04:34:25 user devstack@n-api.service[61596]: exception: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: action_args: {'id': 'af7befec-3f77-4eb7-be53-d1b1e791713e'} Apr 14 04:34:25 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:34:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-07127a5c-7b99-4ca2-9d3c-221b2059e7d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 404 len: 111 microversion: 2.1 time: 0.030751 Apr 14 04:34:25 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 276/821] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:34:25 2023] DELETE /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: af7befec-3f77-4eb7-be53-d1b1e791713e] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:34:25 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e HTTP/1.1 Apr 14 04:34:25 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:34:25 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:34:25 user devstack@n-api.service[61595]: Connection: close Apr 14 04:34:25 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:34:25 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:34:25 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:34:25 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:34:25 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:34:25 user devstack@n-api.service[61595]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:34:25 user devstack@n-api.service[61595]: method: > Apr 14 04:34:25 user devstack@n-api.service[61595]: exception: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: action_args: {'id': 'af7befec-3f77-4eb7-be53-d1b1e791713e'} Apr 14 04:34:25 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. Apr 14 04:34:25 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:34:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance af7befec-3f77-4eb7-be53-d1b1e791713e could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:34:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-be89c56b-d901-453b-b5dc-41a3741c8c59 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e" status: 404 len: 111 microversion: 2.1 time: 0.026812 Apr 14 04:34:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 272/822] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:25 2023] GET /compute/v2.1/servers/af7befec-3f77-4eb7-be53-d1b1e791713e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e7ab547d-8051-485a-a422-f7d25a56e8fd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'create', calling method: .version_select at 0x7f538ad6e9e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1640497739", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFZO4o4kQgpEvaFt8iKOk4kfW7YF9jZ6XS2jVS2UAmaxmR76rP/jf7a3pf4xOyQu5V8HIaLR//SNI2rVtnFikRInNPtRWTjIBvrk9d4sXMIgR6FP64tMb+FLBXcO2su56A=="}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-e7ab547d-8051-485a-a422-f7d25a56e8fd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for project 693d95858c624feaa60114aa89082186. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:34:25 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-e7ab547d-8051-485a-a422-f7d25a56e8fd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for user bcf79de7da27495dbfd14c556b5b54c7 and project 693d95858c624feaa60114aa89082186. Resources: {'key_pairs'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:34:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e7ab547d-8051-485a-a422-f7d25a56e8fd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.047382 Apr 14 04:34:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 275/823] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:34:25 2023] POST /compute/v2.1/os-keypairs => generated 400 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] [instance: 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] HTTP exception thrown: Instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc could not be found. Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Request method failure captured: Apr 14 04:34:28 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc HTTP/1.1 Apr 14 04:34:28 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:34:28 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:34:28 user devstack@n-api.service[61596]: Connection: close Apr 14 04:34:28 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:34:28 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:34:28 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:34:28 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:34:28 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOmH01Hutb9YRw7uP2OlEp2aln8h5oMlw6e03I64C0rdRlcywArRqsgHVh8sCAN_UYylqj-A4cprpWb6TM90dGEKDnyOXHJIuIWR9Q1QhB-vCRVDiHxb9uvmuCKQGukmWIvHvqEv-t6izPrze6I7q7h7D4ZERz8pfCORUpGc7P915g Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Project-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/33320dc2f2c14ecfa5abf6574029c36c"}]}] Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Tenant: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Tenant-Id: 33320dc2f2c14ecfa5abf6574029c36c Apr 14 04:34:28 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-508041341 Apr 14 04:34:28 user devstack@n-api.service[61596]: X-User: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:34:28 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:34:28 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:34:28 user devstack@n-api.service[61596]: X-User-Id: 5234914aec8e443b8a38ac6b38729031 Apr 14 04:34:28 user devstack@n-api.service[61596]: X-User-Name: tempest-ServerRescueNegativeTestJSON-508041341-project-member Apr 14 04:34:28 user devstack@n-api.service[61596]: method: > Apr 14 04:34:28 user devstack@n-api.service[61596]: exception: Instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc could not be found. Apr 14 04:34:28 user devstack@n-api.service[61596]: action_args: {'id': '586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc'} Apr 14 04:34:28 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc could not be found. Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc could not be found. Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc could not be found. Apr 14 04:34:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:34:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] Returning 404 to user: Instance 586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:34:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f023070d-c418-4f45-983e-0f33f8754bb4 tempest-ServerRescueNegativeTestJSON-508041341 tempest-ServerRescueNegativeTestJSON-508041341-project-member] 10.0.0.210 "GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc" status: 404 len: 111 microversion: 2.1 time: 0.028905 Apr 14 04:34:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 277/824] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:28 2023] GET /compute/v2.1/servers/586ca3d5-9ac5-4d3f-868d-7ff7aedf5fbc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:34:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1686619211", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1640497739", "security_groups": [{"name": "tempest-secgroup-smoke-1270427810"}], "block_device_mapping_v2": [{"uuid": "495f173c-6873-42b6-a0fe-42da67f3aa75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e20e0d94-3b17-4872-b774-3a724d3a253b"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:31 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] validate_networks() for [('e20e0d94-3b17-4872-b774-3a724d3a253b', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for user bcf79de7da27495dbfd14c556b5b54c7 and project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:34:32 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='495f173c-6873-42b6-a0fe-42da67f3aa75',volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:34:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-070d1eeb-8692-4250-8cdd-485a0eca3d17 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.894900 Apr 14 04:34:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 273/825] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:34:31 2023] POST /compute/v2.1/servers => generated 404 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:34:32 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4c105b7d-2b61-45aa-9ec6-0fa96ea615f1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:32 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4c105b7d-2b61-45aa-9ec6-0fa96ea615f1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:32 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4c105b7d-2b61-45aa-9ec6-0fa96ea615f1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:32 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4c105b7d-2b61-45aa-9ec6-0fa96ea615f1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 200 len: 1090 microversion: 2.1 time: 0.067360 Apr 14 04:34:32 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 276/826] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:32 2023] GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 1090 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:34:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-98bce72e-cb54-4fbf-ae3d-5b066f7652f2 req-c35942f5-b7f4-4ac8-87d4-454267c0eefe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b704133-1b1a-4579-857a-c74cd8b24fae", "tag": "c0df2242-82c7-408b-bdc2-ab608dee7c1a"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-98bce72e-cb54-4fbf-ae3d-5b066f7652f2 req-c35942f5-b7f4-4ac8-87d4-454267c0eefe service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-98bce72e-cb54-4fbf-ae3d-5b066f7652f2 req-c35942f5-b7f4-4ac8-87d4-454267c0eefe service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-98bce72e-cb54-4fbf-ae3d-5b066f7652f2 req-c35942f5-b7f4-4ac8-87d4-454267c0eefe service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-98bce72e-cb54-4fbf-ae3d-5b066f7652f2 req-c35942f5-b7f4-4ac8-87d4-454267c0eefe service nova] Creating event network-changed:c0df2242-82c7-408b-bdc2-ab608dee7c1a for instance 4b704133-1b1a-4579-857a-c74cd8b24fae on user Apr 14 04:34:36 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-98bce72e-cb54-4fbf-ae3d-5b066f7652f2 req-c35942f5-b7f4-4ac8-87d4-454267c0eefe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030333 Apr 14 04:34:36 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 278/827] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:36 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'action', calling method: >, body: {"rescue": {"rescue_image_ref": "9ee24f9a-817e-4cc1-b650-403209dbb85d"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:39 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lazy-loading 'flavor' on Instance uuid 970e81d2-c227-4eab-92dd-1ed732e67968 {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:34:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-80022fd8-44ab-4ce1-9229-bc5a24035e05 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968/action" status: 200 len: 29 microversion: 2.87 time: 0.517500 Apr 14 04:34:39 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 274/828] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:34:39 2023] POST /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968/action => generated 29 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:40 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:40 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:40 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-8778235d-f49a-4c3a-9ade-1cfbb4281e80 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 200 len: 1775 microversion: 2.87 time: 0.273531 Apr 14 04:34:40 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 277/829] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:34:39 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 1775 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:34:41 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-7caa8efe-336f-464f-84ee-6c7b06af8fcb req-5d9f1ba0-e806-47d7-a481-6136d8d24b27 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-unplugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7caa8efe-336f-464f-84ee-6c7b06af8fcb req-5d9f1ba0-e806-47d7-a481-6136d8d24b27 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7caa8efe-336f-464f-84ee-6c7b06af8fcb req-5d9f1ba0-e806-47d7-a481-6136d8d24b27 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:41 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7caa8efe-336f-464f-84ee-6c7b06af8fcb req-5d9f1ba0-e806-47d7-a481-6136d8d24b27 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-7caa8efe-336f-464f-84ee-6c7b06af8fcb req-5d9f1ba0-e806-47d7-a481-6136d8d24b27 service nova] Creating event network-vif-unplugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:34:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-7caa8efe-336f-464f-84ee-6c7b06af8fcb req-5d9f1ba0-e806-47d7-a481-6136d8d24b27 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031966 Apr 14 04:34:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 275/830] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4cb6a8ea-60e2-4fa6-8bfa-8079ecbb398d tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: .version_select at 0x7f538ab6df30>, body: {"keypair": {"name": "tempest-keypair-499854002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLkMrxFUn3dpVh/tPu0RpQlCyFBaJgCQyQYEwDhdWuIFHQhRjgZJy1F9LImzGW0YKeJb/lrhOq2b/KwQ6C50SgVO3YvlPJwAtkiYLlWF4eUkqOgYRYwPGHjor09Iuea8tQ=="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:41 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-4cb6a8ea-60e2-4fa6-8bfa-8079ecbb398d tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:34:41 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-4cb6a8ea-60e2-4fa6-8bfa-8079ecbb398d tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:34:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4cb6a8ea-60e2-4fa6-8bfa-8079ecbb398d tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.163435 Apr 14 04:34:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 279/831] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:34:41 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-d33c8da1-2ec3-4ede-99c8-889fabbe1a5d req-e0dfd4b1-3066-40cc-b1d8-0d0eca970904 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b704133-1b1a-4579-857a-c74cd8b24fae", "name": "network-vif-plugged", "status": "completed", "tag": "c0df2242-82c7-408b-bdc2-ab608dee7c1a"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:42 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d33c8da1-2ec3-4ede-99c8-889fabbe1a5d req-e0dfd4b1-3066-40cc-b1d8-0d0eca970904 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d33c8da1-2ec3-4ede-99c8-889fabbe1a5d req-e0dfd4b1-3066-40cc-b1d8-0d0eca970904 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d33c8da1-2ec3-4ede-99c8-889fabbe1a5d req-e0dfd4b1-3066-40cc-b1d8-0d0eca970904 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-d33c8da1-2ec3-4ede-99c8-889fabbe1a5d req-e0dfd4b1-3066-40cc-b1d8-0d0eca970904 service nova] Creating event network-vif-plugged:c0df2242-82c7-408b-bdc2-ab608dee7c1a for instance 4b704133-1b1a-4579-857a-c74cd8b24fae on user Apr 14 04:34:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-d33c8da1-2ec3-4ede-99c8-889fabbe1a5d req-e0dfd4b1-3066-40cc-b1d8-0d0eca970904 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037519 Apr 14 04:34:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 278/832] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:43 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:43 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-930330581", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f58d1c12-4d40-40b9-93c5-2db82486289a"}], "security_groups": [{"name": "tempest-securitygroup--1391802999"}], "key_name": "tempest-keypair-499854002", "user_data": "}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-ba9d0115-9d36-4a6d-a82d-bfccb9641380 req-e05bf042-7d97-4669-90f8-ffe2e6861be8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ba9d0115-9d36-4a6d-a82d-bfccb9641380 req-e05bf042-7d97-4669-90f8-ffe2e6861be8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ba9d0115-9d36-4a6d-a82d-bfccb9641380 req-e05bf042-7d97-4669-90f8-ffe2e6861be8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-ba9d0115-9d36-4a6d-a82d-bfccb9641380 req-e05bf042-7d97-4669-90f8-ffe2e6861be8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-ba9d0115-9d36-4a6d-a82d-bfccb9641380 req-e05bf042-7d97-4669-90f8-ffe2e6861be8 service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:34:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-ba9d0115-9d36-4a6d-a82d-bfccb9641380 req-e05bf042-7d97-4669-90f8-ffe2e6861be8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067192 Apr 14 04:34:43 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 280/833] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:43 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] validate_networks() for [('f58d1c12-4d40-40b9-93c5-2db82486289a', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:34:44 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:34:44 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1e47f64e-d6b5-4fa8-936f-b780a785eba4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.625632 Apr 14 04:34:44 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 276/834] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:34:43 2023] POST /compute/v2.1/servers => generated 400 bytes in 627 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:34:44 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f37c9a84-d6aa-42c6-9baf-fcf210792b93 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:44 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f37c9a84-d6aa-42c6-9baf-fcf210792b93 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:44 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-f37c9a84-d6aa-42c6-9baf-fcf210792b93 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:44 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f37c9a84-d6aa-42c6-9baf-fcf210792b93 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115" status: 200 len: 1234 microversion: 2.1 time: 0.088934 Apr 14 04:34:44 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 279/835] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:44 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 => generated 1234 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:34:44 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-8a2a9353-e785-4a46-9817-fd8fa1ac7951 req-7d614dd1-4438-473a-bc46-37c5df42a830 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b704133-1b1a-4579-857a-c74cd8b24fae", "name": "network-vif-plugged", "status": "completed", "tag": "c0df2242-82c7-408b-bdc2-ab608dee7c1a"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-8a2a9353-e785-4a46-9817-fd8fa1ac7951 req-7d614dd1-4438-473a-bc46-37c5df42a830 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-8a2a9353-e785-4a46-9817-fd8fa1ac7951 req-7d614dd1-4438-473a-bc46-37c5df42a830 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:44 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-8a2a9353-e785-4a46-9817-fd8fa1ac7951 req-7d614dd1-4438-473a-bc46-37c5df42a830 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:44 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-8a2a9353-e785-4a46-9817-fd8fa1ac7951 req-7d614dd1-4438-473a-bc46-37c5df42a830 service nova] Creating event network-vif-plugged:c0df2242-82c7-408b-bdc2-ab608dee7c1a for instance 4b704133-1b1a-4579-857a-c74cd8b24fae on user Apr 14 04:34:44 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-8a2a9353-e785-4a46-9817-fd8fa1ac7951 req-7d614dd1-4438-473a-bc46-37c5df42a830 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043743 Apr 14 04:34:44 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 281/836] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:44 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:46 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-837d1c4c-9c70-48f3-b0a4-f0d2edc97687 req-dab68ab6-bbc1-49bd-a4d4-d09114376a62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-837d1c4c-9c70-48f3-b0a4-f0d2edc97687 req-dab68ab6-bbc1-49bd-a4d4-d09114376a62 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-837d1c4c-9c70-48f3-b0a4-f0d2edc97687 req-dab68ab6-bbc1-49bd-a4d4-d09114376a62 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-837d1c4c-9c70-48f3-b0a4-f0d2edc97687 req-dab68ab6-bbc1-49bd-a4d4-d09114376a62 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-837d1c4c-9c70-48f3-b0a4-f0d2edc97687 req-dab68ab6-bbc1-49bd-a4d4-d09114376a62 service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:34:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-837d1c4c-9c70-48f3-b0a4-f0d2edc97687 req-dab68ab6-bbc1-49bd-a4d4-d09114376a62 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036996 Apr 14 04:34:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 277/837] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:46 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:47 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-7815a330-bb9b-4c92-9b65-af9c66166957 req-eb7b0f75-0084-4087-8f72-d8ed59b7cb59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7815a330-bb9b-4c92-9b65-af9c66166957 req-eb7b0f75-0084-4087-8f72-d8ed59b7cb59 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7815a330-bb9b-4c92-9b65-af9c66166957 req-eb7b0f75-0084-4087-8f72-d8ed59b7cb59 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:47 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7815a330-bb9b-4c92-9b65-af9c66166957 req-eb7b0f75-0084-4087-8f72-d8ed59b7cb59 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-7815a330-bb9b-4c92-9b65-af9c66166957 req-eb7b0f75-0084-4087-8f72-d8ed59b7cb59 service nova] Creating event network-changed:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:34:47 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-7815a330-bb9b-4c92-9b65-af9c66166957 req-eb7b0f75-0084-4087-8f72-d8ed59b7cb59 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033465 Apr 14 04:34:47 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 280/838] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:47 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:48 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-4d45c4bb-29b3-4ceb-b400-f01b352d44a7 req-a62554ae-dc49-4a99-b01c-66bbaefed0ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4d45c4bb-29b3-4ceb-b400-f01b352d44a7 req-a62554ae-dc49-4a99-b01c-66bbaefed0ab service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4d45c4bb-29b3-4ceb-b400-f01b352d44a7 req-a62554ae-dc49-4a99-b01c-66bbaefed0ab service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-4d45c4bb-29b3-4ceb-b400-f01b352d44a7 req-a62554ae-dc49-4a99-b01c-66bbaefed0ab service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-4d45c4bb-29b3-4ceb-b400-f01b352d44a7 req-a62554ae-dc49-4a99-b01c-66bbaefed0ab service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:34:48 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-4d45c4bb-29b3-4ceb-b400-f01b352d44a7 req-a62554ae-dc49-4a99-b01c-66bbaefed0ab service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035935 Apr 14 04:34:48 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 282/839] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:48 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:50 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-b03a11aa-14ae-45e5-b082-353322938f86 req-2b5694ca-ab36-45fc-8580-31a0047e7e20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-plugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}, {"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-plugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b03a11aa-14ae-45e5-b082-353322938f86 req-2b5694ca-ab36-45fc-8580-31a0047e7e20 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b03a11aa-14ae-45e5-b082-353322938f86 req-2b5694ca-ab36-45fc-8580-31a0047e7e20 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b03a11aa-14ae-45e5-b082-353322938f86 req-2b5694ca-ab36-45fc-8580-31a0047e7e20 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:50 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-b03a11aa-14ae-45e5-b082-353322938f86 req-2b5694ca-ab36-45fc-8580-31a0047e7e20 service nova] Creating event network-vif-plugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:34:50 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-b03a11aa-14ae-45e5-b082-353322938f86 req-2b5694ca-ab36-45fc-8580-31a0047e7e20 service nova] Creating event network-vif-plugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:34:50 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-b03a11aa-14ae-45e5-b082-353322938f86 req-2b5694ca-ab36-45fc-8580-31a0047e7e20 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.034277 Apr 14 04:34:50 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 278/840] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:50 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=30,nova_api:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-578f05eb-2e41-49d9-b027-21a2ab8d7b25 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.194810 Apr 14 04:34:56 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 281/841] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:34:55 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/os-interface => generated 283 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:57 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-bf60a94d-38f0-4ecb-b1a6-afa0134392bd req-5ac7c3d7-5250-41bf-bcf1-f0727d637fd0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:57 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bf60a94d-38f0-4ecb-b1a6-afa0134392bd req-5ac7c3d7-5250-41bf-bcf1-f0727d637fd0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bf60a94d-38f0-4ecb-b1a6-afa0134392bd req-5ac7c3d7-5250-41bf-bcf1-f0727d637fd0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bf60a94d-38f0-4ecb-b1a6-afa0134392bd req-5ac7c3d7-5250-41bf-bcf1-f0727d637fd0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:57 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=15 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-bf60a94d-38f0-4ecb-b1a6-afa0134392bd req-5ac7c3d7-5250-41bf-bcf1-f0727d637fd0 service nova] Creating event network-changed:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-bf60a94d-38f0-4ecb-b1a6-afa0134392bd req-5ac7c3d7-5250-41bf-bcf1-f0727d637fd0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053295 Apr 14 04:34:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 283/842] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:57 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:34:57 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3d006936-eabb-44cc-bd24-46b9217402fb tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1426 microversion: 2.1 time: 0.403654 Apr 14 04:34:57 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 279/843] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:57 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1426 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:34:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'action', calling method: >, body: {"resize": {"flavorRef": "84"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:57 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for compute:servers:resize:cross_cell failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Old instance type m1.nano, new instance type m1.micro {{(pid=61597) resize /opt/stack/nova/nova/compute/api.py:4223}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Getting quotas for user e35b3ae371cf4dd4b21e2999e58cd2f4 and project 8c14c332dfcc44b49ddf3cb482dd0d4c. Resources: {'ram', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:34:58 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:34:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-31933166-993d-4df1-ac8a-075e136e0307 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/action" status: 202 len: 0 microversion: 2.1 time: 0.386498 Apr 14 04:34:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 282/844] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:34:57 2023] POST /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/action => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:58 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:34:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-bed7022c-efab-4a34-8e19-aa5e87e70678 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1435 microversion: 2.1 time: 0.202604 Apr 14 04:34:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 284/845] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:34:58 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1435 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:34:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-c0f2f984-6874-4e41-954d-e20343ada0a3 req-7fc80f3d-2fbe-444e-986d-0c1860995921 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:34:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c0f2f984-6874-4e41-954d-e20343ada0a3 req-7fc80f3d-2fbe-444e-986d-0c1860995921 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:34:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c0f2f984-6874-4e41-954d-e20343ada0a3 req-7fc80f3d-2fbe-444e-986d-0c1860995921 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:34:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c0f2f984-6874-4e41-954d-e20343ada0a3 req-7fc80f3d-2fbe-444e-986d-0c1860995921 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:34:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-c0f2f984-6874-4e41-954d-e20343ada0a3 req-7fc80f3d-2fbe-444e-986d-0c1860995921 service nova] Creating event network-changed:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:34:59 user devstack@n-api.service[61595]: DEBUG nova.compute.api [req-c0f2f984-6874-4e41-954d-e20343ada0a3 req-7fc80f3d-2fbe-444e-986d-0c1860995921 service nova] Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:34:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-c0f2f984-6874-4e41-954d-e20343ada0a3 req-7fc80f3d-2fbe-444e-986d-0c1860995921 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036073 Apr 14 04:34:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 280/846] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:34:59 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:01 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-bd61a44b-dd49-44d9-b5d3-a9e3fdc909cd req-0c91bbfa-7cb7-42f9-ae6a-2b594805d5c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-unplugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:35:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bd61a44b-dd49-44d9-b5d3-a9e3fdc909cd req-0c91bbfa-7cb7-42f9-ae6a-2b594805d5c8 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bd61a44b-dd49-44d9-b5d3-a9e3fdc909cd req-0c91bbfa-7cb7-42f9-ae6a-2b594805d5c8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:01 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-bd61a44b-dd49-44d9-b5d3-a9e3fdc909cd req-0c91bbfa-7cb7-42f9-ae6a-2b594805d5c8 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:01 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-bd61a44b-dd49-44d9-b5d3-a9e3fdc909cd req-0c91bbfa-7cb7-42f9-ae6a-2b594805d5c8 service nova] Creating event network-vif-unplugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:35:01 user devstack@n-api.service[61597]: DEBUG nova.compute.api [req-bd61a44b-dd49-44d9-b5d3-a9e3fdc909cd req-0c91bbfa-7cb7-42f9-ae6a-2b594805d5c8 service nova] Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61597) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:35:01 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-bd61a44b-dd49-44d9-b5d3-a9e3fdc909cd req-0c91bbfa-7cb7-42f9-ae6a-2b594805d5c8 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043305 Apr 14 04:35:01 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 283/847] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:35:01 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-b02182a6-a89a-4f81-b596-64fe0482f66f req-354deccb-f9c4-48c8-9fad-806f04af73c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-plugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:35:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b02182a6-a89a-4f81-b596-64fe0482f66f req-354deccb-f9c4-48c8-9fad-806f04af73c0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b02182a6-a89a-4f81-b596-64fe0482f66f req-354deccb-f9c4-48c8-9fad-806f04af73c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:03 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b02182a6-a89a-4f81-b596-64fe0482f66f req-354deccb-f9c4-48c8-9fad-806f04af73c0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-b02182a6-a89a-4f81-b596-64fe0482f66f req-354deccb-f9c4-48c8-9fad-806f04af73c0 service nova] Creating event network-vif-plugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:35:03 user devstack@n-api.service[61596]: DEBUG nova.compute.api [req-b02182a6-a89a-4f81-b596-64fe0482f66f req-354deccb-f9c4-48c8-9fad-806f04af73c0 service nova] Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:35:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-b02182a6-a89a-4f81-b596-64fe0482f66f req-354deccb-f9c4-48c8-9fad-806f04af73c0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051492 Apr 14 04:35:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 285/848] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:35:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:11 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:11 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=9 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-7390266f-7c86-492a-8cff-6f8cec3044c6 req-0cc0eb98-ed53-4214-bfb8-71f9a6fc8da5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-plugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:35:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7390266f-7c86-492a-8cff-6f8cec3044c6 req-0cc0eb98-ed53-4214-bfb8-71f9a6fc8da5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7390266f-7c86-492a-8cff-6f8cec3044c6 req-0cc0eb98-ed53-4214-bfb8-71f9a6fc8da5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7390266f-7c86-492a-8cff-6f8cec3044c6 req-0cc0eb98-ed53-4214-bfb8-71f9a6fc8da5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-7390266f-7c86-492a-8cff-6f8cec3044c6 req-0cc0eb98-ed53-4214-bfb8-71f9a6fc8da5 service nova] Creating event network-vif-plugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:35:11 user devstack@n-api.service[61595]: DEBUG nova.compute.api [req-7390266f-7c86-492a-8cff-6f8cec3044c6 req-0cc0eb98-ed53-4214-bfb8-71f9a6fc8da5 service nova] Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61595) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:35:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-7390266f-7c86-492a-8cff-6f8cec3044c6 req-0cc0eb98-ed53-4214-bfb8-71f9a6fc8da5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041470 Apr 14 04:35:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 281/849] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:35:11 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=17 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:13 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:35:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d6365185-a759-4457-9cea-ec1c87050987 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a" status: 200 len: 1539 microversion: 2.1 time: 0.281699 Apr 14 04:35:13 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 284/850] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:35:13 2023] GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a => generated 1539 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:35:13 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=5 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-5c209295-6d5a-45ec-9fa9-89fcbd130a06 req-285a6fec-edb6-4ee8-b3f8-79dd8185d140 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-plugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:35:13 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=11 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5c209295-6d5a-45ec-9fa9-89fcbd130a06 req-285a6fec-edb6-4ee8-b3f8-79dd8185d140 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5c209295-6d5a-45ec-9fa9-89fcbd130a06 req-285a6fec-edb6-4ee8-b3f8-79dd8185d140 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-5c209295-6d5a-45ec-9fa9-89fcbd130a06 req-285a6fec-edb6-4ee8-b3f8-79dd8185d140 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-5c209295-6d5a-45ec-9fa9-89fcbd130a06 req-285a6fec-edb6-4ee8-b3f8-79dd8185d140 service nova] Creating event network-vif-plugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:35:13 user devstack@n-api.service[61596]: DEBUG nova.compute.api [req-5c209295-6d5a-45ec-9fa9-89fcbd130a06 req-285a6fec-edb6-4ee8-b3f8-79dd8185d140 service nova] Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 is migrating within the same cell, copying events to all relevant hosts: {'user'} {{(pid=61596) _get_relevant_hosts /opt/stack/nova/nova/compute/api.py:5948}} Apr 14 04:35:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-5c209295-6d5a-45ec-9fa9-89fcbd130a06 req-285a6fec-edb6-4ee8-b3f8-79dd8185d140 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045086 Apr 14 04:35:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 286/851] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:35:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-8b16f0dc-d8eb-4f9e-b9bf-3c694b99b7e2 req-88dbbc2a-34fe-4090-a5c0-f71bedb8c675 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:35:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-8b16f0dc-d8eb-4f9e-b9bf-3c694b99b7e2 req-88dbbc2a-34fe-4090-a5c0-f71bedb8c675 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-8b16f0dc-d8eb-4f9e-b9bf-3c694b99b7e2 req-88dbbc2a-34fe-4090-a5c0-f71bedb8c675 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-8b16f0dc-d8eb-4f9e-b9bf-3c694b99b7e2 req-88dbbc2a-34fe-4090-a5c0-f71bedb8c675 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-8b16f0dc-d8eb-4f9e-b9bf-3c694b99b7e2 req-88dbbc2a-34fe-4090-a5c0-f71bedb8c675 service nova] Creating event network-changed:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:35:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-8b16f0dc-d8eb-4f9e-b9bf-3c694b99b7e2 req-88dbbc2a-34fe-4090-a5c0-f71bedb8c675 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031991 Apr 14 04:35:14 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 282/852] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:35:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a61cb439-0424-4fe3-8c33-2b14401ebcc7"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-504be20c-4a25-424e-9d21-d34cf7d7fbf7 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.346348 Apr 14 04:35:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 285/853] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:35:15 2023] POST /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments => generated 194 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:22 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:35:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-507eeecb-08f2-49e0-9b39-23b633629a5f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 200 len: 1442 microversion: 2.1 time: 0.152841 Apr 14 04:35:22 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 287/854] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:35:22 2023] GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:23 user devstack@n-api.service[61595]: DEBUG nova.objects.instance [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lazy-loading 'services' on Instance uuid 3746b520-c10a-413e-9f1f-8807b3fd7c9a {{(pid=61595) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:35:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-224bc18a-8e01-444e-a640-74b0cee1e957 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments/a61cb439-0424-4fe3-8c33-2b14401ebcc7" status: 202 len: 0 microversion: 2.1 time: 0.337399 Apr 14 04:35:23 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 283/855] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:35:23 2023] DELETE /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments/a61cb439-0424-4fe3-8c33-2b14401ebcc7 => generated 0 bytes in 348 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f66a285f-6050-4d83-ad62-246d5385ea89 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058355 Apr 14 04:35:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 286/856] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:35:23 2023] GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:35:30 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:35:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-7e12a4fb-a301-4cd5-92d4-a8796a034e62 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 200 len: 1755 microversion: 2.87 time: 0.162026 Apr 14 04:35:30 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 288/857] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:35:30 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:34 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:35:34 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-405f61ad-ffcc-4dd9-9773-3c2e7043be9f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115" status: 200 len: 1544 microversion: 2.1 time: 0.210044 Apr 14 04:35:34 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 284/858] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:35:34 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 => generated 1544 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:35:48 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:35:48 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-00cbcfeb-55bc-4d02-a7cd-5f2dc81b23fa tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1552 microversion: 2.1 time: 0.176201 Apr 14 04:35:48 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 287/859] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:35:48 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1552 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=16 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4b6ed454-e18d-4a1f-9e5a-3b186c7a153a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052761 Apr 14 04:36:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 289/860] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:36:13 2023] GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-7cc06f4d-8d8a-4ad4-9ffd-91ef87e4cd24 req-0fe0f0f2-3949-4fc9-87db-4851541e4b25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7cc06f4d-8d8a-4ad4-9ffd-91ef87e4cd24 req-0fe0f0f2-3949-4fc9-87db-4851541e4b25 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7cc06f4d-8d8a-4ad4-9ffd-91ef87e4cd24 req-0fe0f0f2-3949-4fc9-87db-4851541e4b25 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7cc06f4d-8d8a-4ad4-9ffd-91ef87e4cd24 req-0fe0f0f2-3949-4fc9-87db-4851541e4b25 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:14 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:36:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-7cc06f4d-8d8a-4ad4-9ffd-91ef87e4cd24 req-0fe0f0f2-3949-4fc9-87db-4851541e4b25 service nova] Creating event network-changed:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:36:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-7cc06f4d-8d8a-4ad4-9ffd-91ef87e4cd24 req-0fe0f0f2-3949-4fc9-87db-4851541e4b25 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035181 Apr 14 04:36:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 288/861] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:14 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ac35b12c-39d0-4a1d-8a9a-7e70f60c267d tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a" status: 204 len: 0 microversion: 2.1 time: 0.127455 Apr 14 04:36:14 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 285/862] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:36:14 2023] DELETE /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:14 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:14 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b9b78168-208b-4453-8a95-87be362c9f54 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a" status: 200 len: 1664 microversion: 2.1 time: 0.160220 Apr 14 04:36:14 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 290/863] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:36:14 2023] GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a => generated 1664 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-cbc3eecd-bcc9-41f8-8b11-70152e842d71 req-9e0dc0bf-a06b-452c-be7f-6fe28e6c33f5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "name": "network-vif-unplugged", "status": "completed", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cbc3eecd-bcc9-41f8-8b11-70152e842d71 req-9e0dc0bf-a06b-452c-be7f-6fe28e6c33f5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cbc3eecd-bcc9-41f8-8b11-70152e842d71 req-9e0dc0bf-a06b-452c-be7f-6fe28e6c33f5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-cbc3eecd-bcc9-41f8-8b11-70152e842d71 req-9e0dc0bf-a06b-452c-be7f-6fe28e6c33f5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-cbc3eecd-bcc9-41f8-8b11-70152e842d71 req-9e0dc0bf-a06b-452c-be7f-6fe28e6c33f5 service nova] Creating event network-vif-unplugged:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:36:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-cbc3eecd-bcc9-41f8-8b11-70152e842d71 req-9e0dc0bf-a06b-452c-be7f-6fe28e6c33f5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034481 Apr 14 04:36:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 289/864] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:14 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:16 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0acfe2a2-54a2-4081-8d6a-80b99cd1298e req-6d4e1b9d-d980-48ce-a915-3a33ef147054 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "name": "network-vif-deleted", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0acfe2a2-54a2-4081-8d6a-80b99cd1298e req-6d4e1b9d-d980-48ce-a915-3a33ef147054 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0acfe2a2-54a2-4081-8d6a-80b99cd1298e req-6d4e1b9d-d980-48ce-a915-3a33ef147054 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0acfe2a2-54a2-4081-8d6a-80b99cd1298e req-6d4e1b9d-d980-48ce-a915-3a33ef147054 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0acfe2a2-54a2-4081-8d6a-80b99cd1298e req-6d4e1b9d-d980-48ce-a915-3a33ef147054 service nova] Creating event network-vif-deleted:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:36:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0acfe2a2-54a2-4081-8d6a-80b99cd1298e req-6d4e1b9d-d980-48ce-a915-3a33ef147054 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042099 Apr 14 04:36:16 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 286/865] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-92007df5-29fb-458c-9b0f-7db696dbfaa6 req-5a1d3cca-f943-471c-986c-5c89824cf9a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3746b520-c10a-413e-9f1f-8807b3fd7c9a", "name": "network-vif-plugged", "status": "completed", "tag": "52608de5-fde8-4fd9-81c0-10a060ab7130"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-92007df5-29fb-458c-9b0f-7db696dbfaa6 req-5a1d3cca-f943-471c-986c-5c89824cf9a3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-92007df5-29fb-458c-9b0f-7db696dbfaa6 req-5a1d3cca-f943-471c-986c-5c89824cf9a3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-92007df5-29fb-458c-9b0f-7db696dbfaa6 req-5a1d3cca-f943-471c-986c-5c89824cf9a3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-92007df5-29fb-458c-9b0f-7db696dbfaa6 req-5a1d3cca-f943-471c-986c-5c89824cf9a3 service nova] Creating event network-vif-plugged:52608de5-fde8-4fd9-81c0-10a060ab7130 for instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a on user Apr 14 04:36:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-92007df5-29fb-458c-9b0f-7db696dbfaa6 req-5a1d3cca-f943-471c-986c-5c89824cf9a3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033103 Apr 14 04:36:16 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 291/866] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:16 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:23 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9a5e400e-a1d7-4100-afd2-976f9fed00af tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 200 len: 1442 microversion: 2.1 time: 0.339495 Apr 14 04:36:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 290/867] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:36:22 2023] GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 1442 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:36:25 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0c1cc220-979d-426c-9079-e8503106bd45 req-82bc2afe-3158-454f-ac05-23e3635cb7fe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b704133-1b1a-4579-857a-c74cd8b24fae", "tag": "c0df2242-82c7-408b-bdc2-ab608dee7c1a"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0c1cc220-979d-426c-9079-e8503106bd45 req-82bc2afe-3158-454f-ac05-23e3635cb7fe service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0c1cc220-979d-426c-9079-e8503106bd45 req-82bc2afe-3158-454f-ac05-23e3635cb7fe service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:25 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0c1cc220-979d-426c-9079-e8503106bd45 req-82bc2afe-3158-454f-ac05-23e3635cb7fe service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0c1cc220-979d-426c-9079-e8503106bd45 req-82bc2afe-3158-454f-ac05-23e3635cb7fe service nova] Creating event network-changed:c0df2242-82c7-408b-bdc2-ab608dee7c1a for instance 4b704133-1b1a-4579-857a-c74cd8b24fae on user Apr 14 04:36:25 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0c1cc220-979d-426c-9079-e8503106bd45 req-82bc2afe-3158-454f-ac05-23e3635cb7fe service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030726 Apr 14 04:36:25 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 287/868] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:25 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:25 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:36:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c59dd7d6-200a-460c-bd4f-3c0d2d1a3083 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 204 len: 0 microversion: 2.1 time: 0.123757 Apr 14 04:36:25 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 292/869] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:36:25 2023] DELETE /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:26 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:26 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-048c48e5-96b8-44d5-87c7-11996e98d5ba tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 200 len: 1448 microversion: 2.1 time: 0.225136 Apr 14 04:36:26 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 291/870] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:36:25 2023] GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 1448 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:36:26 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-85050478-6397-496f-a826-dee14890c18b req-31da35c7-515b-4728-83eb-ceeed901764b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b704133-1b1a-4579-857a-c74cd8b24fae", "name": "network-vif-unplugged", "status": "completed", "tag": "c0df2242-82c7-408b-bdc2-ab608dee7c1a"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-85050478-6397-496f-a826-dee14890c18b req-31da35c7-515b-4728-83eb-ceeed901764b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-85050478-6397-496f-a826-dee14890c18b req-31da35c7-515b-4728-83eb-ceeed901764b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-85050478-6397-496f-a826-dee14890c18b req-31da35c7-515b-4728-83eb-ceeed901764b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:26 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-85050478-6397-496f-a826-dee14890c18b req-31da35c7-515b-4728-83eb-ceeed901764b service nova] Creating event network-vif-unplugged:c0df2242-82c7-408b-bdc2-ab608dee7c1a for instance 4b704133-1b1a-4579-857a-c74cd8b24fae on user Apr 14 04:36:26 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-85050478-6397-496f-a826-dee14890c18b req-31da35c7-515b-4728-83eb-ceeed901764b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.028496 Apr 14 04:36:26 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 288/871] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:26 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:27 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-84a9a28e-9839-4d78-b06b-08673bc3c4ba req-0ce12f75-cae6-4bda-b704-cfa2cc8c9276 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b704133-1b1a-4579-857a-c74cd8b24fae", "name": "network-vif-deleted", "tag": "c0df2242-82c7-408b-bdc2-ab608dee7c1a"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-84a9a28e-9839-4d78-b06b-08673bc3c4ba req-0ce12f75-cae6-4bda-b704-cfa2cc8c9276 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-84a9a28e-9839-4d78-b06b-08673bc3c4ba req-0ce12f75-cae6-4bda-b704-cfa2cc8c9276 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-84a9a28e-9839-4d78-b06b-08673bc3c4ba req-0ce12f75-cae6-4bda-b704-cfa2cc8c9276 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-84a9a28e-9839-4d78-b06b-08673bc3c4ba req-0ce12f75-cae6-4bda-b704-cfa2cc8c9276 service nova] Creating event network-vif-deleted:c0df2242-82c7-408b-bdc2-ab608dee7c1a for instance 4b704133-1b1a-4579-857a-c74cd8b24fae on user Apr 14 04:36:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-84a9a28e-9839-4d78-b06b-08673bc3c4ba req-0ce12f75-cae6-4bda-b704-cfa2cc8c9276 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032202 Apr 14 04:36:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 293/872] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-4a76c0b6-d2e1-4cbb-8f0e-95cca4a3dab4 req-a8369cd6-8a41-4e1a-8048-74b7756013c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b704133-1b1a-4579-857a-c74cd8b24fae", "name": "network-vif-plugged", "status": "completed", "tag": "c0df2242-82c7-408b-bdc2-ab608dee7c1a"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4a76c0b6-d2e1-4cbb-8f0e-95cca4a3dab4 req-a8369cd6-8a41-4e1a-8048-74b7756013c4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4a76c0b6-d2e1-4cbb-8f0e-95cca4a3dab4 req-a8369cd6-8a41-4e1a-8048-74b7756013c4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4a76c0b6-d2e1-4cbb-8f0e-95cca4a3dab4 req-a8369cd6-8a41-4e1a-8048-74b7756013c4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-4a76c0b6-d2e1-4cbb-8f0e-95cca4a3dab4 req-a8369cd6-8a41-4e1a-8048-74b7756013c4 service nova] Creating event network-vif-plugged:c0df2242-82c7-408b-bdc2-ab608dee7c1a for instance 4b704133-1b1a-4579-857a-c74cd8b24fae on user Apr 14 04:36:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-4a76c0b6-d2e1-4cbb-8f0e-95cca4a3dab4 req-a8369cd6-8a41-4e1a-8048-74b7756013c4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044193 Apr 14 04:36:28 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 292/873] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:30 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:30 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-abb17ca3-6d6f-4570-916d-4de57970c9f6 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "POST /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968/action" status: 202 len: 0 microversion: 2.87 time: 0.074961 Apr 14 04:36:30 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 289/874] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:36:30 2023] POST /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:30 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d583a957-1268-44ab-834b-9704f5c1721f tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 200 len: 1763 microversion: 2.87 time: 0.185229 Apr 14 04:36:30 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 294/875] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:36:30 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 1763 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:36:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-53d98b7c-e454-4fb9-8221-d8a60fe2f083 req-dea5cf08-7402-47a1-85f6-74152175da1e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-unplugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-53d98b7c-e454-4fb9-8221-d8a60fe2f083 req-dea5cf08-7402-47a1-85f6-74152175da1e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-53d98b7c-e454-4fb9-8221-d8a60fe2f083 req-dea5cf08-7402-47a1-85f6-74152175da1e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-53d98b7c-e454-4fb9-8221-d8a60fe2f083 req-dea5cf08-7402-47a1-85f6-74152175da1e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-53d98b7c-e454-4fb9-8221-d8a60fe2f083 req-dea5cf08-7402-47a1-85f6-74152175da1e service nova] Creating event network-vif-unplugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:36:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-53d98b7c-e454-4fb9-8221-d8a60fe2f083 req-dea5cf08-7402-47a1-85f6-74152175da1e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035466 Apr 14 04:36:31 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 293/876] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:33 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-645bb7ad-8d1f-4f6b-b45e-d3c8968b748d req-c42ba268-bd35-4011-9081-f05c798e717d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:33 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-645bb7ad-8d1f-4f6b-b45e-d3c8968b748d req-c42ba268-bd35-4011-9081-f05c798e717d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:33 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-645bb7ad-8d1f-4f6b-b45e-d3c8968b748d req-c42ba268-bd35-4011-9081-f05c798e717d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:33 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-645bb7ad-8d1f-4f6b-b45e-d3c8968b748d req-c42ba268-bd35-4011-9081-f05c798e717d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:33 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-645bb7ad-8d1f-4f6b-b45e-d3c8968b748d req-c42ba268-bd35-4011-9081-f05c798e717d service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:36:33 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-645bb7ad-8d1f-4f6b-b45e-d3c8968b748d req-c42ba268-bd35-4011-9081-f05c798e717d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053609 Apr 14 04:36:33 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 290/877] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:34 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:34 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-78198945-8ca3-4af8-8b13-eb841c765892 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-interface" status: 200 len: 283 microversion: 2.1 time: 0.124675 Apr 14 04:36:34 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 295/878] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:36:34 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-interface => generated 283 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:35 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-4a7baa64-4637-4048-8f26-a2cdecc1ae56 req-df24e36e-eed3-4539-926e-54524b3e335a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}, {"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4a7baa64-4637-4048-8f26-a2cdecc1ae56 req-df24e36e-eed3-4539-926e-54524b3e335a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4a7baa64-4637-4048-8f26-a2cdecc1ae56 req-df24e36e-eed3-4539-926e-54524b3e335a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:35 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-4a7baa64-4637-4048-8f26-a2cdecc1ae56 req-df24e36e-eed3-4539-926e-54524b3e335a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-4a7baa64-4637-4048-8f26-a2cdecc1ae56 req-df24e36e-eed3-4539-926e-54524b3e335a service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:36:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-4a7baa64-4637-4048-8f26-a2cdecc1ae56 req-df24e36e-eed3-4539-926e-54524b3e335a service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:36:35 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-4a7baa64-4637-4048-8f26-a2cdecc1ae56 req-df24e36e-eed3-4539-926e-54524b3e335a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038280 Apr 14 04:36:35 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 294/879] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:35 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:35 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-502a5a98-8a89-4639-9245-bdce28ee43cb req-34bbcf34-0a7f-4ce5-a9bb-6919fe09c8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-502a5a98-8a89-4639-9245-bdce28ee43cb req-34bbcf34-0a7f-4ce5-a9bb-6919fe09c8d5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-502a5a98-8a89-4639-9245-bdce28ee43cb req-34bbcf34-0a7f-4ce5-a9bb-6919fe09c8d5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:35 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-502a5a98-8a89-4639-9245-bdce28ee43cb req-34bbcf34-0a7f-4ce5-a9bb-6919fe09c8d5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:35 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-502a5a98-8a89-4639-9245-bdce28ee43cb req-34bbcf34-0a7f-4ce5-a9bb-6919fe09c8d5 service nova] Creating event network-changed:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:36:35 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-502a5a98-8a89-4639-9245-bdce28ee43cb req-34bbcf34-0a7f-4ce5-a9bb-6919fe09c8d5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042153 Apr 14 04:36:35 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 291/880] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:35 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:35 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:35 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-3e922403-1f6a-4053-851d-c1a49d18e510 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/ips" status: 200 len: 108 microversion: 2.1 time: 0.034848 Apr 14 04:36:35 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 296/881] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:36:35 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/ips => generated 108 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5615b9ab-7102-4d44-a55e-0e2581c39757"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:38 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:38 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2b8f4352-72ba-4870-8527-26f4acecd97c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.279890 Apr 14 04:36:38 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 295/882] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:36:38 2023] POST /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:46 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:46 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:46 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-37e65178-decd-4554-9ca8-ceb87f1f1594 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: .version_select at 0x7f538835d240>, body: {"keypair": {"name": "tempest-keypair-2114462517", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAesg3BacL1BvdUPXS1xDD/3pqX31IW3Mm7TfS7lU8AJ9AncfmFmDbzZwUcbDyrA39s0koYymJjsrRF/BTnfmAyYfXAFKaGrYBH4j+YINr5ySxpEfDWQcwUiaidQx4WbYw=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:46 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-37e65178-decd-4554-9ca8-ceb87f1f1594 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:36:46 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-37e65178-decd-4554-9ca8-ceb87f1f1594 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:36:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-37e65178-decd-4554-9ca8-ceb87f1f1594 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071404 Apr 14 04:36:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 292/883] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:36:46 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1738062211", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f58d1c12-4d40-40b9-93c5-2db82486289a"}], "security_groups": [{"name": "tempest-securitygroup--675196033"}], "key_name": "tempest-keypair-2114462517", "user_data": "}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] validate_networks() for [('f58d1c12-4d40-40b9-93c5-2db82486289a', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=16 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'action', calling method: >, body: {"confirmResize": {}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:48 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:48 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fbc7d81b-9e12-47bc-87a1-fe0139fcddb1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/action" status: 204 len: 0 microversion: 2.1 time: 0.088328 Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:48 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 296/884] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:36:48 2023] POST /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/action => generated 0 bytes in 90 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:48 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:48 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:48 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:48 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:49 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:49 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:36:49 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:36:49 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:36:49 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:36:49 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-39cb43c6-9bf2-464c-b19f-27a820000f27 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.687556 Apr 14 04:36:49 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 297/885] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:36:48 2023] POST /compute/v2.1/servers => generated 399 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:36:49 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ef4ca70b-4ede-4d33-9ba6-cab8ffd41c81 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:36:49 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ef4ca70b-4ede-4d33-9ba6-cab8ffd41c81 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:36:49 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-ef4ca70b-4ede-4d33-9ba6-cab8ffd41c81 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:49 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ef4ca70b-4ede-4d33-9ba6-cab8ffd41c81 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6" status: 200 len: 1236 microversion: 2.1 time: 0.121712 Apr 14 04:36:49 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 297/886] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:36:49 2023] GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 => generated 1236 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:36:49 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:36:49 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-38977334-0bf4-442d-9ade-87c0f28fb89d tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1552 microversion: 2.1 time: 0.340329 Apr 14 04:36:49 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 293/887] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:36:48 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1552 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:36:52 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-30b1be9f-83e1-4be2-970e-d996db7a9e34 req-1657be7d-1c1a-4e73-866a-8fda445b382c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6", "tag": "345c5341-edef-476a-9b94-e229dc1594b8"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-30b1be9f-83e1-4be2-970e-d996db7a9e34 req-1657be7d-1c1a-4e73-866a-8fda445b382c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-30b1be9f-83e1-4be2-970e-d996db7a9e34 req-1657be7d-1c1a-4e73-866a-8fda445b382c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:52 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-30b1be9f-83e1-4be2-970e-d996db7a9e34 req-1657be7d-1c1a-4e73-866a-8fda445b382c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-30b1be9f-83e1-4be2-970e-d996db7a9e34 req-1657be7d-1c1a-4e73-866a-8fda445b382c service nova] Creating event network-changed:345c5341-edef-476a-9b94-e229dc1594b8 for instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 on user Apr 14 04:36:52 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-30b1be9f-83e1-4be2-970e-d996db7a9e34 req-1657be7d-1c1a-4e73-866a-8fda445b382c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036574 Apr 14 04:36:52 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 298/888] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:52 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a5ba5678-0fd8-411c-b424-909df7426f48 req-56b072ce-d2ff-4c34-ae8a-2d2cc1ba60cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6", "name": "network-vif-plugged", "status": "completed", "tag": "345c5341-edef-476a-9b94-e229dc1594b8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a5ba5678-0fd8-411c-b424-909df7426f48 req-56b072ce-d2ff-4c34-ae8a-2d2cc1ba60cc service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a5ba5678-0fd8-411c-b424-909df7426f48 req-56b072ce-d2ff-4c34-ae8a-2d2cc1ba60cc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a5ba5678-0fd8-411c-b424-909df7426f48 req-56b072ce-d2ff-4c34-ae8a-2d2cc1ba60cc service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a5ba5678-0fd8-411c-b424-909df7426f48 req-56b072ce-d2ff-4c34-ae8a-2d2cc1ba60cc service nova] Creating event network-vif-plugged:345c5341-edef-476a-9b94-e229dc1594b8 for instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 on user Apr 14 04:36:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a5ba5678-0fd8-411c-b424-909df7426f48 req-56b072ce-d2ff-4c34-ae8a-2d2cc1ba60cc service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031090 Apr 14 04:36:54 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 298/889] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:36:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f0fa6887-3e93-452a-9b4e-a5271b32fcf5 req-8df70c30-1014-443f-8700-596790fdeab2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6", "name": "network-vif-plugged", "status": "completed", "tag": "345c5341-edef-476a-9b94-e229dc1594b8"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:36:56 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:36:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f0fa6887-3e93-452a-9b4e-a5271b32fcf5 req-8df70c30-1014-443f-8700-596790fdeab2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:36:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f0fa6887-3e93-452a-9b4e-a5271b32fcf5 req-8df70c30-1014-443f-8700-596790fdeab2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:36:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f0fa6887-3e93-452a-9b4e-a5271b32fcf5 req-8df70c30-1014-443f-8700-596790fdeab2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:36:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f0fa6887-3e93-452a-9b4e-a5271b32fcf5 req-8df70c30-1014-443f-8700-596790fdeab2 service nova] Creating event network-vif-plugged:345c5341-edef-476a-9b94-e229dc1594b8 for instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 on user Apr 14 04:36:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f0fa6887-3e93-452a-9b4e-a5271b32fcf5 req-8df70c30-1014-443f-8700-596790fdeab2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038075 Apr 14 04:36:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 294/890] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:36:56 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=17,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 3746b520-c10a-413e-9f1f-8807b3fd7c9a] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] HTTP exception thrown: Instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a could not be found. Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Request method failure captured: Apr 14 04:37:04 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a HTTP/1.1 Apr 14 04:37:04 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:37:04 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:37:04 user devstack@n-api.service[61596]: Connection: close Apr 14 04:37:04 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:37:04 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:37:04 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:37:04 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:37:04 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONbH6E7bJ_Jyb9iqJ5MBXE-l_guLJT3cWam-uyBNfUCxk61ocPk63wXQ9FHhOQph2btQJLhgT43bZaTFssWYh6wwTEmdhPWIYqtdjoLp74UVlc2RIeNRECuVhnhfTIIIk8SKXe-rd9xtr9dEe9okqa_BvIExgzvuehZeyIXr7Ib-q2M Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Project-Id: 0e6175a4372245a4a57dca1f12f7f007 Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestStampPattern-267011728 Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e6175a4372245a4a57dca1f12f7f007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e6175a4372245a4a57dca1f12f7f007"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e6175a4372245a4a57dca1f12f7f007"}]}] Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Tenant: tempest-TestStampPattern-267011728 Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Tenant-Id: 0e6175a4372245a4a57dca1f12f7f007 Apr 14 04:37:04 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestStampPattern-267011728 Apr 14 04:37:04 user devstack@n-api.service[61596]: X-User: tempest-TestStampPattern-267011728-project-member Apr 14 04:37:04 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:37:04 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:37:04 user devstack@n-api.service[61596]: X-User-Id: ebe3f41b95824cd78193d0bbe206a66b Apr 14 04:37:04 user devstack@n-api.service[61596]: X-User-Name: tempest-TestStampPattern-267011728-project-member Apr 14 04:37:04 user devstack@n-api.service[61596]: method: > Apr 14 04:37:04 user devstack@n-api.service[61596]: exception: Instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a could not be found. Apr 14 04:37:04 user devstack@n-api.service[61596]: action_args: {'id': '3746b520-c10a-413e-9f1f-8807b3fd7c9a'} Apr 14 04:37:04 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a could not be found. Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a could not be found. Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a could not be found. Apr 14 04:37:04 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:04 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Returning 404 to user: Instance 3746b520-c10a-413e-9f1f-8807b3fd7c9a could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:37:04 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-569d4130-c6f6-453f-946f-0a0eb9b13787 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a" status: 404 len: 111 microversion: 2.1 time: 0.048072 Apr 14 04:37:04 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 299/891] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:37:04 2023] GET /compute/v2.1/servers/3746b520-c10a-413e-9f1f-8807b3fd7c9a => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=13,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] HTTP exception thrown: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 is not attached to volume cd931337-f058-4d2e-bb9b-21d50e96a28b Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Request method failure captured: Apr 14 04:37:11 user devstack@n-api.service[61597]: request: DELETE /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments/cd931337-f058-4d2e-bb9b-21d50e96a28b HTTP/1.1 Apr 14 04:37:11 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:37:11 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:37:11 user devstack@n-api.service[61597]: Connection: close Apr 14 04:37:11 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:37:11 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:37:11 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:37:11 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:37:11 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONbH6E7bJ_Jyb9iqJ5MBXE-l_guLJT3cWam-uyBNfUCxk61ocPk63wXQ9FHhOQph2btQJLhgT43bZaTFssWYh6wwTEmdhPWIYqtdjoLp74UVlc2RIeNRECuVhnhfTIIIk8SKXe-rd9xtr9dEe9okqa_BvIExgzvuehZeyIXr7Ib-q2M Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Project-Id: 0e6175a4372245a4a57dca1f12f7f007 Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Project-Name: tempest-TestStampPattern-267011728 Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e6175a4372245a4a57dca1f12f7f007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e6175a4372245a4a57dca1f12f7f007"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e6175a4372245a4a57dca1f12f7f007"}]}] Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Tenant: tempest-TestStampPattern-267011728 Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Tenant-Id: 0e6175a4372245a4a57dca1f12f7f007 Apr 14 04:37:11 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TestStampPattern-267011728 Apr 14 04:37:11 user devstack@n-api.service[61597]: X-User: tempest-TestStampPattern-267011728-project-member Apr 14 04:37:11 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:37:11 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:37:11 user devstack@n-api.service[61597]: X-User-Id: ebe3f41b95824cd78193d0bbe206a66b Apr 14 04:37:11 user devstack@n-api.service[61597]: X-User-Name: tempest-TestStampPattern-267011728-project-member Apr 14 04:37:11 user devstack@n-api.service[61597]: method: > Apr 14 04:37:11 user devstack@n-api.service[61597]: exception: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 is not attached to volume cd931337-f058-4d2e-bb9b-21d50e96a28b Apr 14 04:37:11 user devstack@n-api.service[61597]: action_args: {'server_id': '390ca845-5660-49d0-bd8a-fcfc39176ca5', 'id': 'cd931337-f058-4d2e-bb9b-21d50e96a28b'} Apr 14 04:37:11 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id cd931337-f058-4d2e-bb9b-21d50e96a28b. Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 is not attached to volume cd931337-f058-4d2e-bb9b-21d50e96a28b Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 is not attached to volume cd931337-f058-4d2e-bb9b-21d50e96a28b Apr 14 04:37:11 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:37:11 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Returning 404 to user: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 is not attached to volume cd931337-f058-4d2e-bb9b-21d50e96a28b {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:37:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-49243639-6252-4ea6-8edf-70dd6d72ef20 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments/cd931337-f058-4d2e-bb9b-21d50e96a28b" status: 404 len: 154 microversion: 2.1 time: 0.119091 Apr 14 04:37:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 299/892] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:37:11 2023] DELETE /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5/os-volume_attachments/cd931337-f058-4d2e-bb9b-21d50e96a28b => generated 154 bytes in 122 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=8 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:12 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-39913795-598c-457c-a229-bdcb0353106f req-e4bf2211-bb62-4371-8411-09f540f9de43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-39913795-598c-457c-a229-bdcb0353106f req-e4bf2211-bb62-4371-8411-09f540f9de43 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-39913795-598c-457c-a229-bdcb0353106f req-e4bf2211-bb62-4371-8411-09f540f9de43 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-39913795-598c-457c-a229-bdcb0353106f req-e4bf2211-bb62-4371-8411-09f540f9de43 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-39913795-598c-457c-a229-bdcb0353106f req-e4bf2211-bb62-4371-8411-09f540f9de43 service nova] Creating event network-changed:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:37:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-39913795-598c-457c-a229-bdcb0353106f req-e4bf2211-bb62-4371-8411-09f540f9de43 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089643 Apr 14 04:37:12 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 300/893] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:37:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-bd57c173-ba39-4398-ac92-c1a2d9c3790a tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5" status: 204 len: 0 microversion: 2.1 time: 0.134543 Apr 14 04:37:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 295/894] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:37:12 2023] DELETE /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:12 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebe3f41b95824cd78193d0bbe206a66b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0e6175a4372245a4a57dca1f12f7f007', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:37:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ebdf9a5d-7be1-4ba7-8b7e-b42610eed5a5 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5" status: 200 len: 1662 microversion: 2.1 time: 0.202472 Apr 14 04:37:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 300/895] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:37:12 2023] GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5 => generated 1662 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-815d7c49-ddf3-487a-b3a5-1055791b7596 req-7162f005-2f0b-45df-8946-eefbf5d3405d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "name": "network-vif-unplugged", "status": "completed", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-815d7c49-ddf3-487a-b3a5-1055791b7596 req-7162f005-2f0b-45df-8946-eefbf5d3405d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-815d7c49-ddf3-487a-b3a5-1055791b7596 req-7162f005-2f0b-45df-8946-eefbf5d3405d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-815d7c49-ddf3-487a-b3a5-1055791b7596 req-7162f005-2f0b-45df-8946-eefbf5d3405d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-815d7c49-ddf3-487a-b3a5-1055791b7596 req-7162f005-2f0b-45df-8946-eefbf5d3405d service nova] Creating event network-vif-unplugged:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:37:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-815d7c49-ddf3-487a-b3a5-1055791b7596 req-7162f005-2f0b-45df-8946-eefbf5d3405d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030788 Apr 14 04:37:12 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 301/896] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:37:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:14 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0f41d822-68ea-41bf-a759-8bcef1666e7e req-a9e082c8-9299-4f1b-a3e6-03f9bedad223 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "name": "network-vif-deleted", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0f41d822-68ea-41bf-a759-8bcef1666e7e req-a9e082c8-9299-4f1b-a3e6-03f9bedad223 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0f41d822-68ea-41bf-a759-8bcef1666e7e req-a9e082c8-9299-4f1b-a3e6-03f9bedad223 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:14 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0f41d822-68ea-41bf-a759-8bcef1666e7e req-a9e082c8-9299-4f1b-a3e6-03f9bedad223 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0f41d822-68ea-41bf-a759-8bcef1666e7e req-a9e082c8-9299-4f1b-a3e6-03f9bedad223 service nova] Creating event network-vif-deleted:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:37:14 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0f41d822-68ea-41bf-a759-8bcef1666e7e req-a9e082c8-9299-4f1b-a3e6-03f9bedad223 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031267 Apr 14 04:37:14 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 296/897] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:37:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-5f1b11b7-92a3-42c4-9f37-e5185c83e7c5 req-c6a1248c-cdd5-4738-b65d-f153c6e1f246 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "390ca845-5660-49d0-bd8a-fcfc39176ca5", "name": "network-vif-plugged", "status": "completed", "tag": "488d7017-4718-4554-80f0-7fb119efc417"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5f1b11b7-92a3-42c4-9f37-e5185c83e7c5 req-c6a1248c-cdd5-4738-b65d-f153c6e1f246 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5f1b11b7-92a3-42c4-9f37-e5185c83e7c5 req-c6a1248c-cdd5-4738-b65d-f153c6e1f246 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-5f1b11b7-92a3-42c4-9f37-e5185c83e7c5 req-c6a1248c-cdd5-4738-b65d-f153c6e1f246 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-5f1b11b7-92a3-42c4-9f37-e5185c83e7c5 req-c6a1248c-cdd5-4738-b65d-f153c6e1f246 service nova] Creating event network-vif-plugged:488d7017-4718-4554-80f0-7fb119efc417 for instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 on user Apr 14 04:37:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-5f1b11b7-92a3-42c4-9f37-e5185c83e7c5 req-c6a1248c-cdd5-4738-b65d-f153c6e1f246 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038000 Apr 14 04:37:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 301/898] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:37:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:37:16 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae HTTP/1.1 Apr 14 04:37:16 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:37:16 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:37:16 user devstack@n-api.service[61596]: Connection: close Apr 14 04:37:16 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:37:16 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:37:16 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:37:16 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:37:16 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:37:16 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:37:16 user devstack@n-api.service[61596]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:37:16 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:37:16 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:37:16 user devstack@n-api.service[61596]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:37:16 user devstack@n-api.service[61596]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:37:16 user devstack@n-api.service[61596]: method: > Apr 14 04:37:16 user devstack@n-api.service[61596]: exception: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:37:16 user devstack@n-api.service[61596]: action_args: {'id': '4b704133-1b1a-4579-857a-c74cd8b24fae'} Apr 14 04:37:16 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:37:16 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:37:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:37:16 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b293a552-611c-4e6e-94b6-4280791d9b5e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 404 len: 111 microversion: 2.1 time: 0.028469 Apr 14 04:37:16 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 302/899] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:37:16 2023] GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1983263653", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1640497739", "security_groups": [{"name": "tempest-secgroup-smoke-1270427810"}], "block_device_mapping_v2": [{"uuid": "495f173c-6873-42b6-a0fe-42da67f3aa75", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e20e0d94-3b17-4872-b774-3a724d3a253b"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] validate_networks() for [('e20e0d94-3b17-4872-b774-3a724d3a253b', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for user bcf79de7da27495dbfd14c556b5b54c7 and project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:37:16 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='495f173c-6873-42b6-a0fe-42da67f3aa75',volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:37:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7572834d-6bac-47ce-b3d7-0fe44ce0c9c9 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.859845 Apr 14 04:37:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 297/900] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:37:16 2023] POST /compute/v2.1/servers => generated 404 bytes in 864 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:37:17 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4bb95595-8ced-4536-9986-07ce0f28a5d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4bb95595-8ced-4536-9986-07ce0f28a5d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:17 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4bb95595-8ced-4536-9986-07ce0f28a5d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:37:17 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4bb95595-8ced-4536-9986-07ce0f28a5d3 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27" status: 200 len: 1090 microversion: 2.1 time: 0.070060 Apr 14 04:37:17 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 302/901] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:37:17 2023] GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27 => generated 1090 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:37:19 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-7e970dc1-d44c-4f78-98e9-10bed5a258b7 req-97a97174-4dc6-4cad-9fc7-fd3321cde257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-7e970dc1-d44c-4f78-98e9-10bed5a258b7 req-97a97174-4dc6-4cad-9fc7-fd3321cde257 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-7e970dc1-d44c-4f78-98e9-10bed5a258b7 req-97a97174-4dc6-4cad-9fc7-fd3321cde257 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-7e970dc1-d44c-4f78-98e9-10bed5a258b7 req-97a97174-4dc6-4cad-9fc7-fd3321cde257 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-7e970dc1-d44c-4f78-98e9-10bed5a258b7 req-97a97174-4dc6-4cad-9fc7-fd3321cde257 service nova] Creating event network-changed:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:37:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-7e970dc1-d44c-4f78-98e9-10bed5a258b7 req-97a97174-4dc6-4cad-9fc7-fd3321cde257 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031837 Apr 14 04:37:19 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 303/902] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:37:19 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:20 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:37:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:37:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:37:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4cd38451-98bc-437c-8adc-25f7f46400bd tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 200 len: 1769 microversion: 2.87 time: 0.227757 Apr 14 04:37:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 298/903] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:37:20 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 1769 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:37:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-404ac653-e345-461c-87bf-ac9418fab40e req-4d6c3b51-4975-4007-af6d-0cb1e92dfe50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "name": "network-vif-plugged", "status": "completed", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:25 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=14 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-404ac653-e345-461c-87bf-ac9418fab40e req-4d6c3b51-4975-4007-af6d-0cb1e92dfe50 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-404ac653-e345-461c-87bf-ac9418fab40e req-4d6c3b51-4975-4007-af6d-0cb1e92dfe50 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-404ac653-e345-461c-87bf-ac9418fab40e req-4d6c3b51-4975-4007-af6d-0cb1e92dfe50 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-404ac653-e345-461c-87bf-ac9418fab40e req-4d6c3b51-4975-4007-af6d-0cb1e92dfe50 service nova] Creating event network-vif-plugged:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:37:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-404ac653-e345-461c-87bf-ac9418fab40e req-4d6c3b51-4975-4007-af6d-0cb1e92dfe50 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064970 Apr 14 04:37:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 303/904] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:37:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:27 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-f28e61fe-919b-499c-91d5-c609e6606023 req-36bded07-e7e7-44f1-af59-fe68524b7d5e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "name": "network-vif-plugged", "status": "completed", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:37:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f28e61fe-919b-499c-91d5-c609e6606023 req-36bded07-e7e7-44f1-af59-fe68524b7d5e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f28e61fe-919b-499c-91d5-c609e6606023 req-36bded07-e7e7-44f1-af59-fe68524b7d5e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:27 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-f28e61fe-919b-499c-91d5-c609e6606023 req-36bded07-e7e7-44f1-af59-fe68524b7d5e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:27 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-f28e61fe-919b-499c-91d5-c609e6606023 req-36bded07-e7e7-44f1-af59-fe68524b7d5e service nova] Creating event network-vif-plugged:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:37:27 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-f28e61fe-919b-499c-91d5-c609e6606023 req-36bded07-e7e7-44f1-af59-fe68524b7d5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028792 Apr 14 04:37:27 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 304/905] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:37:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=12 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:37:39 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:37:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4851f155-d4ff-48d8-9dbc-8a77cce9a845 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6" status: 200 len: 1544 microversion: 2.1 time: 0.176901 Apr 14 04:37:39 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 299/906] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:37:39 2023] GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 => generated 1544 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:37:39 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:37:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f184e3c0-ebff-468f-bc54-0629ccda3125 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1544 microversion: 2.1 time: 0.176324 Apr 14 04:37:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 304/907] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:37:39 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1544 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=12 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=12 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] [instance: 390ca845-5660-49d0-bd8a-fcfc39176ca5] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] HTTP exception thrown: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 could not be found. Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Request method failure captured: Apr 14 04:38:02 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5 HTTP/1.1 Apr 14 04:38:02 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:38:02 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:38:02 user devstack@n-api.service[61596]: Connection: close Apr 14 04:38:02 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:38:02 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:38:02 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:38:02 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:38:02 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONbH6E7bJ_Jyb9iqJ5MBXE-l_guLJT3cWam-uyBNfUCxk61ocPk63wXQ9FHhOQph2btQJLhgT43bZaTFssWYh6wwTEmdhPWIYqtdjoLp74UVlc2RIeNRECuVhnhfTIIIk8SKXe-rd9xtr9dEe9okqa_BvIExgzvuehZeyIXr7Ib-q2M Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Project-Id: 0e6175a4372245a4a57dca1f12f7f007 Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestStampPattern-267011728 Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/0e6175a4372245a4a57dca1f12f7f007"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e6175a4372245a4a57dca1f12f7f007"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/0e6175a4372245a4a57dca1f12f7f007"}]}] Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Tenant: tempest-TestStampPattern-267011728 Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Tenant-Id: 0e6175a4372245a4a57dca1f12f7f007 Apr 14 04:38:02 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestStampPattern-267011728 Apr 14 04:38:02 user devstack@n-api.service[61596]: X-User: tempest-TestStampPattern-267011728-project-member Apr 14 04:38:02 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:38:02 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:38:02 user devstack@n-api.service[61596]: X-User-Id: ebe3f41b95824cd78193d0bbe206a66b Apr 14 04:38:02 user devstack@n-api.service[61596]: X-User-Name: tempest-TestStampPattern-267011728-project-member Apr 14 04:38:02 user devstack@n-api.service[61596]: method: > Apr 14 04:38:02 user devstack@n-api.service[61596]: exception: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 could not be found. Apr 14 04:38:02 user devstack@n-api.service[61596]: action_args: {'id': '390ca845-5660-49d0-bd8a-fcfc39176ca5'} Apr 14 04:38:02 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 could not be found. Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 could not be found. Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 could not be found. Apr 14 04:38:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:38:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Returning 404 to user: Instance 390ca845-5660-49d0-bd8a-fcfc39176ca5 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:38:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d5ff8701-e2bb-4f7c-85ff-a92ea8a7d067 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5" status: 404 len: 111 microversion: 2.1 time: 0.041806 Apr 14 04:38:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 305/908] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:38:02 2023] GET /compute/v2.1/servers/390ca845-5660-49d0-bd8a-fcfc39176ca5 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:38:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d802cede-fcf7-4765-bf44-f449443028b1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] Calling method '.version_select at 0x7f538aceae60>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:06 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:06 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d802cede-fcf7-4765-bf44-f449443028b1 tempest-TestStampPattern-267011728 tempest-TestStampPattern-267011728-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1877604753" status: 202 len: 0 microversion: 2.1 time: 0.038559 Apr 14 04:38:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 300/909] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:38:06 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestStampPattern-1877604753 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:07 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:38:07 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-84b2d87b-32b1-4247-b7eb-b9e2a8dfa7f7 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27" status: 200 len: 1443 microversion: 2.1 time: 0.215979 Apr 14 04:38:07 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 305/910] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:38:07 2023] GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27 => generated 1443 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:21 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:38:21 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-295f03cf-81f8-4e44-b8e8-34a4f61ee3a4 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 204 len: 0 microversion: 2.87 time: 0.363348 Apr 14 04:38:21 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 306/911] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:38:21 2023] DELETE /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=3,nova_api:DELETE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:38:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:38:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4c81e11b-73f9-4773-b4de-e479fc522e76 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 200 len: 1775 microversion: 2.87 time: 0.189190 Apr 14 04:38:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 301/912] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:38:21 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 1775 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:38:21 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:21 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-55bc72bf-8493-4f1f-a3c1-6b89fb760eb5 req-d5045adb-b1f5-40bd-bd64-9c3038956a36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-unplugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-55bc72bf-8493-4f1f-a3c1-6b89fb760eb5 req-d5045adb-b1f5-40bd-bd64-9c3038956a36 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-55bc72bf-8493-4f1f-a3c1-6b89fb760eb5 req-d5045adb-b1f5-40bd-bd64-9c3038956a36 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-55bc72bf-8493-4f1f-a3c1-6b89fb760eb5 req-d5045adb-b1f5-40bd-bd64-9c3038956a36 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-55bc72bf-8493-4f1f-a3c1-6b89fb760eb5 req-d5045adb-b1f5-40bd-bd64-9c3038956a36 service nova] Creating event network-vif-unplugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:38:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-55bc72bf-8493-4f1f-a3c1-6b89fb760eb5 req-d5045adb-b1f5-40bd-bd64-9c3038956a36 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.127085 Apr 14 04:38:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 306/913] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:38:21 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:38:23 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-7c70633f-bc9d-4acb-9697-1e15d1068cb8 req-86050a4b-ebe9-4af3-b3dc-5c81a7fd923d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-deleted", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-7c70633f-bc9d-4acb-9697-1e15d1068cb8 req-86050a4b-ebe9-4af3-b3dc-5c81a7fd923d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-7c70633f-bc9d-4acb-9697-1e15d1068cb8 req-86050a4b-ebe9-4af3-b3dc-5c81a7fd923d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:23 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-7c70633f-bc9d-4acb-9697-1e15d1068cb8 req-86050a4b-ebe9-4af3-b3dc-5c81a7fd923d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:23 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-7c70633f-bc9d-4acb-9697-1e15d1068cb8 req-86050a4b-ebe9-4af3-b3dc-5c81a7fd923d service nova] Creating event network-vif-deleted:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:38:23 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-7c70633f-bc9d-4acb-9697-1e15d1068cb8 req-86050a4b-ebe9-4af3-b3dc-5c81a7fd923d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029815 Apr 14 04:38:23 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 307/914] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:38:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:38:23 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-4917ffe9-9808-4cda-9f31-babe8281d21b req-8d20b9de-9c84-4639-9919-98e34e98887a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "970e81d2-c227-4eab-92dd-1ed732e67968", "name": "network-vif-plugged", "status": "completed", "tag": "45a5a643-510a-45e2-a8e4-12eb53631daf"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4917ffe9-9808-4cda-9f31-babe8281d21b req-8d20b9de-9c84-4639-9919-98e34e98887a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4917ffe9-9808-4cda-9f31-babe8281d21b req-8d20b9de-9c84-4639-9919-98e34e98887a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4917ffe9-9808-4cda-9f31-babe8281d21b req-8d20b9de-9c84-4639-9919-98e34e98887a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-4917ffe9-9808-4cda-9f31-babe8281d21b req-8d20b9de-9c84-4639-9919-98e34e98887a service nova] Creating event network-vif-plugged:45a5a643-510a-45e2-a8e4-12eb53631daf for instance 970e81d2-c227-4eab-92dd-1ed732e67968 on user Apr 14 04:38:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-4917ffe9-9808-4cda-9f31-babe8281d21b req-8d20b9de-9c84-4639-9919-98e34e98887a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034222 Apr 14 04:38:23 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 302/915] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:38:23 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:39 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-13412a33-3234-40a7-8f2b-177a9c962383 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.101717 Apr 14 04:38:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 307/916] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:38:39 2023] GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6/os-interface => generated 282 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:39 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:38:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-55a9b280-1c76-4c39-80b3-c75d286c75f3 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1544 microversion: 2.1 time: 0.649233 Apr 14 04:38:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 308/917] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:38:39 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1544 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=8 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-894064b2-6948-428b-aa97-c1bcd7ffe895 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "POST /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/action" status: 200 len: 28258 microversion: 2.1 time: 0.239277 Apr 14 04:38:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 303/918] 10.0.0.210 () {64 vars in 1355 bytes} [Fri Apr 14 04:38:40 2023] POST /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65/action => generated 28258 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:38:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-8d693e24-f24c-4b72-94da-c6cb3062380a tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c" status: 200 len: 1537 microversion: 2.1 time: 0.204905 Apr 14 04:38:40 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 308/919] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:38:40 2023] GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c => generated 1537 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-da0a8366-d8b8-403d-a6b8-7603fb83ee21 req-e8aa7062-5e0e-436f-90e1-b5fe692ddb7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6", "tag": "345c5341-edef-476a-9b94-e229dc1594b8"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:40 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-410b7359-f4b7-4640-b7e3-3a50faafa0a8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6/ips" status: 200 len: 107 microversion: 2.1 time: 0.040272 Apr 14 04:38:40 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 304/920] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:38:40 2023] GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6/ips => generated 107 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:38:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-da0a8366-d8b8-403d-a6b8-7603fb83ee21 req-e8aa7062-5e0e-436f-90e1-b5fe692ddb7b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-da0a8366-d8b8-403d-a6b8-7603fb83ee21 req-e8aa7062-5e0e-436f-90e1-b5fe692ddb7b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-da0a8366-d8b8-403d-a6b8-7603fb83ee21 req-e8aa7062-5e0e-436f-90e1-b5fe692ddb7b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5615b9ab-7102-4d44-a55e-0e2581c39757"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-da0a8366-d8b8-403d-a6b8-7603fb83ee21 req-e8aa7062-5e0e-436f-90e1-b5fe692ddb7b service nova] Creating event network-changed:345c5341-edef-476a-9b94-e229dc1594b8 for instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 on user Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-da0a8366-d8b8-403d-a6b8-7603fb83ee21 req-e8aa7062-5e0e-436f-90e1-b5fe692ddb7b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102770 Apr 14 04:38:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 309/921] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:38:40 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:38:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Invalid volume: volume 5615b9ab-7102-4d44-a55e-0e2581c39757 is already attached to instances: 283ef25b-314a-47c1-8414-9d7c737e5115 Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:38:40 user devstack@n-api.service[61597]: request: POST /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6/os-volume_attachments HTTP/1.1 Apr 14 04:38:40 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:38:40 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:38:40 user devstack@n-api.service[61597]: Connection: close Apr 14 04:38:40 user devstack@n-api.service[61597]: Content-Length: 74 Apr 14 04:38:40 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:38:40 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:38:40 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:38:40 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:38:40 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:38:40 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:38:40 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:38:40 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:38:40 user devstack@n-api.service[61597]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:38:40 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:38:40 user devstack@n-api.service[61597]: Apr 14 04:38:40 user devstack@n-api.service[61597]: {"volumeAttachment": {"volumeId": "5615b9ab-7102-4d44-a55e-0e2581c39757"}} Apr 14 04:38:40 user devstack@n-api.service[61597]: method: > Apr 14 04:38:40 user devstack@n-api.service[61597]: exception: Invalid volume: volume 5615b9ab-7102-4d44-a55e-0e2581c39757 is already attached to instances: 283ef25b-314a-47c1-8414-9d7c737e5115 Apr 14 04:38:40 user devstack@n-api.service[61597]: action_args: {'server_id': '6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6', 'body': {'volumeAttachment': {'volumeId': '5615b9ab-7102-4d44-a55e-0e2581c39757'}}} Apr 14 04:38:40 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5615b9ab-7102-4d44-a55e-0e2581c39757 is already attached to instances: 283ef25b-314a-47c1-8414-9d7c737e5115 Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5615b9ab-7102-4d44-a55e-0e2581c39757 is already attached to instances: 283ef25b-314a-47c1-8414-9d7c737e5115 Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5615b9ab-7102-4d44-a55e-0e2581c39757 is already attached to instances: 283ef25b-314a-47c1-8414-9d7c737e5115 Apr 14 04:38:40 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:38:40 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 400 to user: Invalid volume: volume 5615b9ab-7102-4d44-a55e-0e2581c39757 is already attached to instances: 283ef25b-314a-47c1-8414-9d7c737e5115 {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:38:40 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3544a2db-34cd-4130-b39c-d57b2b43e704 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.104365 Apr 14 04:38:40 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 309/922] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:38:40 2023] POST /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:38:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-7caa0ba7-2a9a-4238-ae2e-f08b99c43953 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6" status: 204 len: 0 microversion: 2.1 time: 0.118733 Apr 14 04:38:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 305/923] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:38:40 2023] DELETE /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:38:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-6176894a-a818-4618-866c-865561d71727 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6" status: 200 len: 1550 microversion: 2.1 time: 0.319103 Apr 14 04:38:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 310/924] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:38:41 2023] GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 => generated 1550 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:38:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-c056bb60-ef24-45b6-be4c-c700e56793b1 req-7f5ae7dd-fd9c-4a3c-b30f-4c3e71cabee1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6", "name": "network-vif-deleted", "tag": "345c5341-edef-476a-9b94-e229dc1594b8"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c056bb60-ef24-45b6-be4c-c700e56793b1 req-7f5ae7dd-fd9c-4a3c-b30f-4c3e71cabee1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c056bb60-ef24-45b6-be4c-c700e56793b1 req-7f5ae7dd-fd9c-4a3c-b30f-4c3e71cabee1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:42 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-c056bb60-ef24-45b6-be4c-c700e56793b1 req-7f5ae7dd-fd9c-4a3c-b30f-4c3e71cabee1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-c056bb60-ef24-45b6-be4c-c700e56793b1 req-7f5ae7dd-fd9c-4a3c-b30f-4c3e71cabee1 service nova] Creating event network-vif-deleted:345c5341-edef-476a-9b94-e229dc1594b8 for instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 on user Apr 14 04:38:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-c056bb60-ef24-45b6-be4c-c700e56793b1 req-7f5ae7dd-fd9c-4a3c-b30f-4c3e71cabee1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028234 Apr 14 04:38:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 310/925] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:38:42 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:38:42 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-4fe66287-d9a6-4805-bd8f-2baf17260e4e req-cf8e3ba6-8497-4572-9a5e-e4386cc9caef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6", "name": "network-vif-unplugged", "status": "completed", "tag": "345c5341-edef-476a-9b94-e229dc1594b8"}, {"server_uuid": "6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6", "name": "network-vif-plugged", "status": "completed", "tag": "345c5341-edef-476a-9b94-e229dc1594b8"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:38:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4fe66287-d9a6-4805-bd8f-2baf17260e4e req-cf8e3ba6-8497-4572-9a5e-e4386cc9caef service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:38:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4fe66287-d9a6-4805-bd8f-2baf17260e4e req-cf8e3ba6-8497-4572-9a5e-e4386cc9caef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:38:42 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4fe66287-d9a6-4805-bd8f-2baf17260e4e req-cf8e3ba6-8497-4572-9a5e-e4386cc9caef service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:38:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-4fe66287-d9a6-4805-bd8f-2baf17260e4e req-cf8e3ba6-8497-4572-9a5e-e4386cc9caef service nova] Creating event network-vif-unplugged:345c5341-edef-476a-9b94-e229dc1594b8 for instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 on user Apr 14 04:38:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-4fe66287-d9a6-4805-bd8f-2baf17260e4e req-cf8e3ba6-8497-4572-9a5e-e4386cc9caef service nova] Creating event network-vif-plugged:345c5341-edef-476a-9b94-e229dc1594b8 for instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 on user Apr 14 04:38:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-4fe66287-d9a6-4805-bd8f-2baf17260e4e req-cf8e3ba6-8497-4572-9a5e-e4386cc9caef service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.030058 Apr 14 04:38:42 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 306/926] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:38:42 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=14 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:07 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:39:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-79062c08-cd28-4c7c-8845-0862127080ca tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27" status: 200 len: 1443 microversion: 2.1 time: 0.153125 Apr 14 04:39:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 311/927] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:39:07 2023] GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27 => generated 1443 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:39:10 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:10 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=18 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-0e7f1daa-e185-4ad0-a2e1-3c4dc26a18e1 req-1076aa86-3792-4728-ae92-267d78e1ec37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0e7f1daa-e185-4ad0-a2e1-3c4dc26a18e1 req-1076aa86-3792-4728-ae92-267d78e1ec37 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0e7f1daa-e185-4ad0-a2e1-3c4dc26a18e1 req-1076aa86-3792-4728-ae92-267d78e1ec37 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-0e7f1daa-e185-4ad0-a2e1-3c4dc26a18e1 req-1076aa86-3792-4728-ae92-267d78e1ec37 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-0e7f1daa-e185-4ad0-a2e1-3c4dc26a18e1 req-1076aa86-3792-4728-ae92-267d78e1ec37 service nova] Creating event network-changed:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:39:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-0e7f1daa-e185-4ad0-a2e1-3c4dc26a18e1 req-1076aa86-3792-4728-ae92-267d78e1ec37 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037908 Apr 14 04:39:10 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 311/928] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 970e81d2-c227-4eab-92dd-1ed732e67968] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] HTTP exception thrown: Instance 970e81d2-c227-4eab-92dd-1ed732e67968 could not be found. Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Request method failure captured: Apr 14 04:39:11 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 HTTP/1.1 Apr 14 04:39:11 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:39:11 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:39:11 user devstack@n-api.service[61595]: Connection: close Apr 14 04:39:11 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:39:11 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:39:11 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:39:11 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:39:11 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONS76MWJ4n8hA--Tzr8oPchQjWfpotP5FZ97pMY97n8AJKq3YA5jlvZaD94JbBAsJYRB0panTs-KixaLHUdC5Ef50JOGpmjscfREquBX4EaKPDoPrNu3tI_9AWEeWDfC5CZY_a3w_zrzKUowXnQ9u3oX_z8zNgDHQHsS_HAugGXq1FE Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Project-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}] Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Tenant-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-User: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:39:11 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:39:11 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:39:11 user devstack@n-api.service[61595]: X-User-Id: 6ec7103e06e643a6b9b2c908ba8d7b06 Apr 14 04:39:11 user devstack@n-api.service[61595]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:39:11 user devstack@n-api.service[61595]: method: > Apr 14 04:39:11 user devstack@n-api.service[61595]: exception: Instance 970e81d2-c227-4eab-92dd-1ed732e67968 could not be found. Apr 14 04:39:11 user devstack@n-api.service[61595]: action_args: {'id': '970e81d2-c227-4eab-92dd-1ed732e67968'} Apr 14 04:39:11 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 970e81d2-c227-4eab-92dd-1ed732e67968 could not be found. Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 970e81d2-c227-4eab-92dd-1ed732e67968 could not be found. Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 970e81d2-c227-4eab-92dd-1ed732e67968 could not be found. Apr 14 04:39:11 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:39:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Returning 404 to user: Instance 970e81d2-c227-4eab-92dd-1ed732e67968 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:39:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b9090615-49fa-487e-b8ce-79c0d9a0a117 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968" status: 404 len: 111 microversion: 2.87 time: 0.050590 Apr 14 04:39:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 307/929] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:39:11 2023] GET /compute/v2.1/servers/970e81d2-c227-4eab-92dd-1ed732e67968 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:12 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:39:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1bc589e7-1a00-4861-b491-7109a7e87471 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc" status: 204 len: 0 microversion: 2.87 time: 0.122005 Apr 14 04:39:12 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 312/930] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:39:12 2023] DELETE /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:39:12 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:39:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d227f5e7-aea0-446a-9c62-93b38d8603ce tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc" status: 200 len: 1696 microversion: 2.87 time: 0.223124 Apr 14 04:39:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 312/931] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:39:12 2023] GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc => generated 1696 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:39:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-f0442e61-549b-4bc2-8538-ea9982155d16 req-b5fb0fe6-d360-4e34-b368-d134ebd7cbf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a166de-f0c9-43f2-8c88-585e0d5d22cc", "name": "network-vif-unplugged", "status": "completed", "tag": "e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f0442e61-549b-4bc2-8538-ea9982155d16 req-b5fb0fe6-d360-4e34-b368-d134ebd7cbf9 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f0442e61-549b-4bc2-8538-ea9982155d16 req-b5fb0fe6-d360-4e34-b368-d134ebd7cbf9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-f0442e61-549b-4bc2-8538-ea9982155d16 req-b5fb0fe6-d360-4e34-b368-d134ebd7cbf9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-f0442e61-549b-4bc2-8538-ea9982155d16 req-b5fb0fe6-d360-4e34-b368-d134ebd7cbf9 service nova] Creating event network-vif-unplugged:e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d for instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc on user Apr 14 04:39:12 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-f0442e61-549b-4bc2-8538-ea9982155d16 req-b5fb0fe6-d360-4e34-b368-d134ebd7cbf9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036700 Apr 14 04:39:12 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 308/932] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:12 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-bd2fb9cd-d1e9-4b8c-916f-7a5ce781dde7 req-52172413-df33-491f-be16-b5bcc0949cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a166de-f0c9-43f2-8c88-585e0d5d22cc", "name": "network-vif-deleted", "tag": "e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bd2fb9cd-d1e9-4b8c-916f-7a5ce781dde7 req-52172413-df33-491f-be16-b5bcc0949cc3 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bd2fb9cd-d1e9-4b8c-916f-7a5ce781dde7 req-52172413-df33-491f-be16-b5bcc0949cc3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-bd2fb9cd-d1e9-4b8c-916f-7a5ce781dde7 req-52172413-df33-491f-be16-b5bcc0949cc3 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-bd2fb9cd-d1e9-4b8c-916f-7a5ce781dde7 req-52172413-df33-491f-be16-b5bcc0949cc3 service nova] Creating event network-vif-deleted:e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d for instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc on user Apr 14 04:39:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-bd2fb9cd-d1e9-4b8c-916f-7a5ce781dde7 req-52172413-df33-491f-be16-b5bcc0949cc3 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034404 Apr 14 04:39:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 313/933] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:14 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-43f69a4b-5ea1-4e79-88b7-038020acb24e req-0443816d-7734-488e-a66a-994b7ff79d90 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "19a166de-f0c9-43f2-8c88-585e0d5d22cc", "name": "network-vif-plugged", "status": "completed", "tag": "e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-43f69a4b-5ea1-4e79-88b7-038020acb24e req-0443816d-7734-488e-a66a-994b7ff79d90 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-43f69a4b-5ea1-4e79-88b7-038020acb24e req-0443816d-7734-488e-a66a-994b7ff79d90 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:14 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-43f69a4b-5ea1-4e79-88b7-038020acb24e req-0443816d-7734-488e-a66a-994b7ff79d90 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-43f69a4b-5ea1-4e79-88b7-038020acb24e req-0443816d-7734-488e-a66a-994b7ff79d90 service nova] Creating event network-vif-plugged:e4576e1c-dfe3-4ab1-aa2a-4edfad4dd02d for instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc on user Apr 14 04:39:14 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-43f69a4b-5ea1-4e79-88b7-038020acb24e req-0443816d-7734-488e-a66a-994b7ff79d90 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042381 Apr 14 04:39:14 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 313/934] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:14 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2046991816", "imageRef": "", "flavorRef": "42", "key_name": "tempest-TestVolumeBootPattern-1640497739", "security_groups": [{"name": "tempest-secgroup-smoke-1270427810"}], "block_device_mapping_v2": [{"uuid": "350da73c-f3b8-4777-b0d2-56bc054366d1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "e20e0d94-3b17-4872-b774-3a724d3a253b"}]}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.network.neutron [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] validate_networks() for [('e20e0d94-3b17-4872-b774-3a724d3a253b', None, None, None, None, None)] {{(pid=61595) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image limits 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Flavor pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Image pref 0:0:0 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.virt.hardware [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61595) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Getting quotas for user bcf79de7da27495dbfd14c556b5b54c7 and project 693d95858c624feaa60114aa89082186. Resources: {'ram', 'instances', 'cores'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Going to run 1 instances... {{(pid=61595) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:39:17 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='350da73c-f3b8-4777-b0d2-56bc054366d1',volume_size=None,volume_type=None)] {{(pid=61595) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:39:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-60ab6c41-b0c0-4f26-a6c8-b3be552e9445 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.767612 Apr 14 04:39:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 309/935] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:39:17 2023] POST /compute/v2.1/servers => generated 404 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 450 bytes (2 switches on core 0) Apr 14 04:39:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f0905acb-cb86-45e8-9644-8eb4e04d5ab6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:18 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f0905acb-cb86-45e8-9644-8eb4e04d5ab6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:18 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-f0905acb-cb86-45e8-9644-8eb4e04d5ab6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:39:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f0905acb-cb86-45e8-9644-8eb4e04d5ab6 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121" status: 200 len: 1090 microversion: 2.1 time: 0.060766 Apr 14 04:39:18 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 314/936] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:39:18 2023] GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121 => generated 1090 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:39:20 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-d10ec554-d724-4046-8305-4be30c0bfcd2 req-76dc1119-3619-4f79-a196-8646aabb857f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d10ec554-d724-4046-8305-4be30c0bfcd2 req-76dc1119-3619-4f79-a196-8646aabb857f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d10ec554-d724-4046-8305-4be30c0bfcd2 req-76dc1119-3619-4f79-a196-8646aabb857f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:20 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-d10ec554-d724-4046-8305-4be30c0bfcd2 req-76dc1119-3619-4f79-a196-8646aabb857f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:20 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-d10ec554-d724-4046-8305-4be30c0bfcd2 req-76dc1119-3619-4f79-a196-8646aabb857f service nova] Creating event network-changed:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:39:20 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-d10ec554-d724-4046-8305-4be30c0bfcd2 req-76dc1119-3619-4f79-a196-8646aabb857f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031593 Apr 14 04:39:20 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 314/937] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:20 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:26 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-e75f2dd4-fcd2-46ee-af34-5aeced50824e req-261bdde0-e29c-4e2b-a6c2-3f1f451bd194 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "name": "network-vif-plugged", "status": "completed", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e75f2dd4-fcd2-46ee-af34-5aeced50824e req-261bdde0-e29c-4e2b-a6c2-3f1f451bd194 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e75f2dd4-fcd2-46ee-af34-5aeced50824e req-261bdde0-e29c-4e2b-a6c2-3f1f451bd194 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:26 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e75f2dd4-fcd2-46ee-af34-5aeced50824e req-261bdde0-e29c-4e2b-a6c2-3f1f451bd194 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:26 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e75f2dd4-fcd2-46ee-af34-5aeced50824e req-261bdde0-e29c-4e2b-a6c2-3f1f451bd194 service nova] Creating event network-vif-plugged:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:39:26 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-e75f2dd4-fcd2-46ee-af34-5aeced50824e req-261bdde0-e29c-4e2b-a6c2-3f1f451bd194 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031167 Apr 14 04:39:26 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 310/938] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1bbe6a8c-d3de-47d6-ab95-671b6600be91 req-a33c4ad8-e933-4a5e-86e3-b7b14cf6f2d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "name": "network-vif-plugged", "status": "completed", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1bbe6a8c-d3de-47d6-ab95-671b6600be91 req-a33c4ad8-e933-4a5e-86e3-b7b14cf6f2d1 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1bbe6a8c-d3de-47d6-ab95-671b6600be91 req-a33c4ad8-e933-4a5e-86e3-b7b14cf6f2d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1bbe6a8c-d3de-47d6-ab95-671b6600be91 req-a33c4ad8-e933-4a5e-86e3-b7b14cf6f2d1 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1bbe6a8c-d3de-47d6-ab95-671b6600be91 req-a33c4ad8-e933-4a5e-86e3-b7b14cf6f2d1 service nova] Creating event network-vif-plugged:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:39:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1bbe6a8c-d3de-47d6-ab95-671b6600be91 req-a33c4ad8-e933-4a5e-86e3-b7b14cf6f2d1 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042647 Apr 14 04:39:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 315/939] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=10 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=12 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:39:31 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 HTTP/1.1 Apr 14 04:39:31 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:39:31 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:39:31 user devstack@n-api.service[61597]: Connection: close Apr 14 04:39:31 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:39:31 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:39:31 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:39:31 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:39:31 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:39:31 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:39:31 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:39:31 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:39:31 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:39:31 user devstack@n-api.service[61597]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:39:31 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:39:31 user devstack@n-api.service[61597]: method: > Apr 14 04:39:31 user devstack@n-api.service[61597]: exception: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:39:31 user devstack@n-api.service[61597]: action_args: {'id': '6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6'} Apr 14 04:39:31 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:39:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:39:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:39:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2449fcc9-9898-4bfd-b653-e40ba4016eb2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6" status: 404 len: 111 microversion: 2.1 time: 0.043808 Apr 14 04:39:31 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 315/940] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:39:31 2023] GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:39:31 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:31 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3354a2fc-bbcb-4b98-a5ca-5694c0d38369 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '.version_select at 0x7f538835d3f0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3354a2fc-bbcb-4b98-a5ca-5694c0d38369 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114462517" status: 202 len: 0 microversion: 2.1 time: 0.025812 Apr 14 04:39:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 311/941] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:39:31 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2114462517 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:32 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lazy-loading 'services' on Instance uuid 283ef25b-314a-47c1-8414-9d7c737e5115 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:39:32 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5779441c-e5a7-4390-9bce-59c49cafb02a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments/5615b9ab-7102-4d44-a55e-0e2581c39757" status: 202 len: 0 microversion: 2.1 time: 0.171628 Apr 14 04:39:32 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 316/942] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:39:32 2023] DELETE /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments/5615b9ab-7102-4d44-a55e-0e2581c39757 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:32 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:32 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-6b7a528c-a94a-4590-b08a-40e459dae0d2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062334 Apr 14 04:39:32 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 316/943] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:39:32 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=8 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:40 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:39:41 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d6bff91f-e726-4850-ae52-d41bdcb3e0b1 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 204 len: 0 microversion: 2.1 time: 0.179477 Apr 14 04:39:41 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 312/944] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:39:40 2023] DELETE /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:41 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:39:41 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-af54b7d7-d091-4c6d-9320-54f03b2c9c75 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 200 len: 1550 microversion: 2.1 time: 0.228056 Apr 14 04:39:41 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 317/945] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:39:41 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 1550 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:39:41 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-3544f947-7191-4004-8ca9-3f437b137a9e req-621dfdb1-0162-4de8-992b-bb45877a024b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-unplugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3544f947-7191-4004-8ca9-3f437b137a9e req-621dfdb1-0162-4de8-992b-bb45877a024b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3544f947-7191-4004-8ca9-3f437b137a9e req-621dfdb1-0162-4de8-992b-bb45877a024b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:41 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-3544f947-7191-4004-8ca9-3f437b137a9e req-621dfdb1-0162-4de8-992b-bb45877a024b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-3544f947-7191-4004-8ca9-3f437b137a9e req-621dfdb1-0162-4de8-992b-bb45877a024b service nova] Creating event network-vif-unplugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:39:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-3544f947-7191-4004-8ca9-3f437b137a9e req-621dfdb1-0162-4de8-992b-bb45877a024b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029085 Apr 14 04:39:41 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 317/946] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:41 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-1f31f810-aa52-4daa-a17d-14b883426b96 req-83100610-7055-4009-9345-495a814e943c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-deleted", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:43 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:39:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1f31f810-aa52-4daa-a17d-14b883426b96 req-83100610-7055-4009-9345-495a814e943c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1f31f810-aa52-4daa-a17d-14b883426b96 req-83100610-7055-4009-9345-495a814e943c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1f31f810-aa52-4daa-a17d-14b883426b96 req-83100610-7055-4009-9345-495a814e943c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-1f31f810-aa52-4daa-a17d-14b883426b96 req-83100610-7055-4009-9345-495a814e943c service nova] Creating event network-vif-deleted:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:39:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-1f31f810-aa52-4daa-a17d-14b883426b96 req-83100610-7055-4009-9345-495a814e943c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048928 Apr 14 04:39:43 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 313/947] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:39:43 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-07c5c969-4c88-4ef4-9e02-6e4fc4333078 req-590f6175-8699-4055-b2fc-666f583da460 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "695d931b-1f30-4d57-b6d7-d199d2874e65", "name": "network-vif-plugged", "status": "completed", "tag": "3562cd0d-8f80-4113-a397-b56e4455ef4a"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:39:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-07c5c969-4c88-4ef4-9e02-6e4fc4333078 req-590f6175-8699-4055-b2fc-666f583da460 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:39:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-07c5c969-4c88-4ef4-9e02-6e4fc4333078 req-590f6175-8699-4055-b2fc-666f583da460 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:39:43 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-07c5c969-4c88-4ef4-9e02-6e4fc4333078 req-590f6175-8699-4055-b2fc-666f583da460 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:39:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-07c5c969-4c88-4ef4-9e02-6e4fc4333078 req-590f6175-8699-4055-b2fc-666f583da460 service nova] Creating event network-vif-plugged:3562cd0d-8f80-4113-a397-b56e4455ef4a for instance 695d931b-1f30-4d57-b6d7-d199d2874e65 on user Apr 14 04:39:43 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-07c5c969-4c88-4ef4-9e02-6e4fc4333078 req-590f6175-8699-4055-b2fc-666f583da460 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039771 Apr 14 04:39:43 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 318/948] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:39:43 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=10 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 19a166de-f0c9-43f2-8c88-585e0d5d22cc] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] HTTP exception thrown: Instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc could not be found. Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Request method failure captured: Apr 14 04:40:02 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc HTTP/1.1 Apr 14 04:40:02 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:40:02 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:40:02 user devstack@n-api.service[61597]: Connection: close Apr 14 04:40:02 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:40:02 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:40:02 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:40:02 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:40:02 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONS76MWJ4n8hA--Tzr8oPchQjWfpotP5FZ97pMY97n8AJKq3YA5jlvZaD94JbBAsJYRB0panTs-KixaLHUdC5Ef50JOGpmjscfREquBX4EaKPDoPrNu3tI_9AWEeWDfC5CZY_a3w_zrzKUowXnQ9u3oX_z8zNgDHQHsS_HAugGXq1FE Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Project-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}] Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Tenant-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-User: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:40:02 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:40:02 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:40:02 user devstack@n-api.service[61597]: X-User-Id: 6ec7103e06e643a6b9b2c908ba8d7b06 Apr 14 04:40:02 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:40:02 user devstack@n-api.service[61597]: method: > Apr 14 04:40:02 user devstack@n-api.service[61597]: exception: Instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc could not be found. Apr 14 04:40:02 user devstack@n-api.service[61597]: action_args: {'id': '19a166de-f0c9-43f2-8c88-585e0d5d22cc'} Apr 14 04:40:02 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc could not be found. Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc could not be found. Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc could not be found. Apr 14 04:40:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Returning 404 to user: Instance 19a166de-f0c9-43f2-8c88-585e0d5d22cc could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:40:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-685639a3-9b93-4ab0-9d5b-367457e079c7 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc" status: 404 len: 111 microversion: 2.87 time: 0.035219 Apr 14 04:40:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 318/949] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:40:02 2023] GET /compute/v2.1/servers/19a166de-f0c9-43f2-8c88-585e0d5d22cc => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:02 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:40:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ee648a24-65c5-441a-a367-c24fa9284c53 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 204 len: 0 microversion: 2.87 time: 0.131113 Apr 14 04:40:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 314/950] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:40:02 2023] DELETE /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=19,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:02 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-525ad29e-de0d-4b71-a302-d7cb04303680 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 200 len: 1776 microversion: 2.87 time: 0.244603 Apr 14 04:40:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 319/951] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:40:02 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 1776 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-7b077c91-7e6d-4f59-a2a1-0ef14d2d20bc req-cb03e486-1e9d-4057-8b44-bb8e6a0ab53e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-unplugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7b077c91-7e6d-4f59-a2a1-0ef14d2d20bc req-cb03e486-1e9d-4057-8b44-bb8e6a0ab53e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7b077c91-7e6d-4f59-a2a1-0ef14d2d20bc req-cb03e486-1e9d-4057-8b44-bb8e6a0ab53e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-7b077c91-7e6d-4f59-a2a1-0ef14d2d20bc req-cb03e486-1e9d-4057-8b44-bb8e6a0ab53e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-7b077c91-7e6d-4f59-a2a1-0ef14d2d20bc req-cb03e486-1e9d-4057-8b44-bb8e6a0ab53e service nova] Creating event network-vif-unplugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:40:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-7b077c91-7e6d-4f59-a2a1-0ef14d2d20bc req-cb03e486-1e9d-4057-8b44-bb8e6a0ab53e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032473 Apr 14 04:40:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 319/952] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:02 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:04 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-2bad1a3b-8a26-45b9-ad7a-508b0f153292 req-702338aa-35ee-4b21-b65c-8c9456e3b4b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-deleted", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2bad1a3b-8a26-45b9-ad7a-508b0f153292 req-702338aa-35ee-4b21-b65c-8c9456e3b4b9 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2bad1a3b-8a26-45b9-ad7a-508b0f153292 req-702338aa-35ee-4b21-b65c-8c9456e3b4b9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2bad1a3b-8a26-45b9-ad7a-508b0f153292 req-702338aa-35ee-4b21-b65c-8c9456e3b4b9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2bad1a3b-8a26-45b9-ad7a-508b0f153292 req-702338aa-35ee-4b21-b65c-8c9456e3b4b9 service nova] Creating event network-vif-deleted:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:40:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-2bad1a3b-8a26-45b9-ad7a-508b0f153292 req-702338aa-35ee-4b21-b65c-8c9456e3b4b9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036134 Apr 14 04:40:04 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 315/953] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:04 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:05 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-2999db5e-7e95-4b1f-810a-79ec6400f83e req-aec0dfa6-37c2-4528-95b7-02c4d03e14e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3df97db3-fd6c-4be6-af32-7cde9dbcce75", "name": "network-vif-plugged", "status": "completed", "tag": "6baf0637-1ee9-4ccb-93a3-264041fb73f3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2999db5e-7e95-4b1f-810a-79ec6400f83e req-aec0dfa6-37c2-4528-95b7-02c4d03e14e4 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2999db5e-7e95-4b1f-810a-79ec6400f83e req-aec0dfa6-37c2-4528-95b7-02c4d03e14e4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2999db5e-7e95-4b1f-810a-79ec6400f83e req-aec0dfa6-37c2-4528-95b7-02c4d03e14e4 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:05 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2999db5e-7e95-4b1f-810a-79ec6400f83e req-aec0dfa6-37c2-4528-95b7-02c4d03e14e4 service nova] Creating event network-vif-plugged:6baf0637-1ee9-4ccb-93a3-264041fb73f3 for instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 on user Apr 14 04:40:05 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-2999db5e-7e95-4b1f-810a-79ec6400f83e req-aec0dfa6-37c2-4528-95b7-02c4d03e14e4 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030142 Apr 14 04:40:05 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 320/954] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:08 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-fd9d93da-bbe5-4a2b-9ae3-5cf146aa2dc1 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121" status: 200 len: 1442 microversion: 2.1 time: 0.158860 Apr 14 04:40:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 320/955] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:40:08 2023] GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121 => generated 1442 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=10,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0fb908e5-90de-4ae0-902e-b5a94f1598d1 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.172685 Apr 14 04:40:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 316/956] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:40:22 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115/os-volume_attachments => generated 25 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:22 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:40:22 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e83b3325-f30f-4402-a4ee-490fe8292a22 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115" status: 204 len: 0 microversion: 2.1 time: 0.135389 Apr 14 04:40:22 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 321/957] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:40:22 2023] DELETE /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=10 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:22 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:23 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:23 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-8be4dfde-5144-4859-b8ff-7e147b579a24 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115" status: 200 len: 1669 microversion: 2.1 time: 0.184053 Apr 14 04:40:23 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 321/958] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:40:22 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 => generated 1669 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:40:23 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-833a5a82-27e9-46ab-b569-5ee09d3788b7 req-cf5b90e6-7f70-456a-8daf-5ed899a9ac5f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-unplugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-833a5a82-27e9-46ab-b569-5ee09d3788b7 req-cf5b90e6-7f70-456a-8daf-5ed899a9ac5f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-833a5a82-27e9-46ab-b569-5ee09d3788b7 req-cf5b90e6-7f70-456a-8daf-5ed899a9ac5f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-833a5a82-27e9-46ab-b569-5ee09d3788b7 req-cf5b90e6-7f70-456a-8daf-5ed899a9ac5f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-833a5a82-27e9-46ab-b569-5ee09d3788b7 req-cf5b90e6-7f70-456a-8daf-5ed899a9ac5f service nova] Creating event network-vif-unplugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:40:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-833a5a82-27e9-46ab-b569-5ee09d3788b7 req-cf5b90e6-7f70-456a-8daf-5ed899a9ac5f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037628 Apr 14 04:40:23 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 317/959] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:23 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:24 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-3f77e5c5-c67c-4e22-b949-d15739c6dd07 req-10bb0de1-f74b-4fc8-b565-c069559351e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-deleted", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3f77e5c5-c67c-4e22-b949-d15739c6dd07 req-10bb0de1-f74b-4fc8-b565-c069559351e9 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3f77e5c5-c67c-4e22-b949-d15739c6dd07 req-10bb0de1-f74b-4fc8-b565-c069559351e9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3f77e5c5-c67c-4e22-b949-d15739c6dd07 req-10bb0de1-f74b-4fc8-b565-c069559351e9 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:24 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-3f77e5c5-c67c-4e22-b949-d15739c6dd07 req-10bb0de1-f74b-4fc8-b565-c069559351e9 service nova] Creating event network-vif-deleted:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:40:24 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-3f77e5c5-c67c-4e22-b949-d15739c6dd07 req-10bb0de1-f74b-4fc8-b565-c069559351e9 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032589 Apr 14 04:40:24 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 322/960] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:24 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:25 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-plugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}, {"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-plugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}, {"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-plugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}, {"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-unplugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}, {"server_uuid": "283ef25b-314a-47c1-8414-9d7c737e5115", "name": "network-vif-plugged", "status": "completed", "tag": "4734e3dd-22a1-4d25-b2cd-e19ef4f66f83"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:25 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Creating event network-vif-plugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:40:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Creating event network-vif-plugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:40:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Creating event network-vif-plugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:40:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Creating event network-vif-unplugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:40:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] Creating event network-vif-plugged:4734e3dd-22a1-4d25-b2cd-e19ef4f66f83 for instance 283ef25b-314a-47c1-8414-9d7c737e5115 on user Apr 14 04:40:25 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-81a94549-71d5-41c2-b2e6-fbc423429e28 req-91e8c73f-e209-4412-a20f-bc22083e9d69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 869 microversion: 2.1 time: 0.040267 Apr 14 04:40:25 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 322/961] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:25 2023] POST /compute/v2.1/os-server-external-events => generated 869 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:40:31 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 HTTP/1.1 Apr 14 04:40:31 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:40:31 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:40:31 user devstack@n-api.service[61595]: Connection: close Apr 14 04:40:31 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:40:31 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:40:31 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:40:31 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:40:31 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:40:31 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61595]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:40:31 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:40:31 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:40:31 user devstack@n-api.service[61595]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:40:31 user devstack@n-api.service[61595]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:40:31 user devstack@n-api.service[61595]: method: > Apr 14 04:40:31 user devstack@n-api.service[61595]: exception: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61595]: action_args: {'id': '695d931b-1f30-4d57-b6d7-d199d2874e65'} Apr 14 04:40:31 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:40:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d44e0d93-77eb-4e7b-b9b9-bcf70c365db6 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 404 len: 111 microversion: 2.1 time: 0.033082 Apr 14 04:40:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 318/962] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:40:31 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:40:31 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 HTTP/1.1 Apr 14 04:40:31 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:40:31 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:40:31 user devstack@n-api.service[61596]: Connection: close Apr 14 04:40:31 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:40:31 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:40:31 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:40:31 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:40:31 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:40:31 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61596]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:40:31 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:40:31 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:40:31 user devstack@n-api.service[61596]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:40:31 user devstack@n-api.service[61596]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:40:31 user devstack@n-api.service[61596]: method: > Apr 14 04:40:31 user devstack@n-api.service[61596]: exception: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61596]: action_args: {'id': '695d931b-1f30-4d57-b6d7-d199d2874e65'} Apr 14 04:40:31 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:40:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5ad5d0f5-cb80-46dd-992a-9faf78d925b5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 404 len: 111 microversion: 2.1 time: 0.030553 Apr 14 04:40:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 323/963] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:40:31 2023] DELETE /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 695d931b-1f30-4d57-b6d7-d199d2874e65] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:40:31 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 HTTP/1.1 Apr 14 04:40:31 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:40:31 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:40:31 user devstack@n-api.service[61597]: Connection: close Apr 14 04:40:31 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:40:31 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:40:31 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:40:31 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:40:31 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:40:31 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:40:31 user devstack@n-api.service[61597]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:40:31 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:40:31 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:40:31 user devstack@n-api.service[61597]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:40:31 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:40:31 user devstack@n-api.service[61597]: method: > Apr 14 04:40:31 user devstack@n-api.service[61597]: exception: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61597]: action_args: {'id': '695d931b-1f30-4d57-b6d7-d199d2874e65'} Apr 14 04:40:31 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. Apr 14 04:40:31 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance 695d931b-1f30-4d57-b6d7-d199d2874e65 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:40:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ba33abc8-d706-4074-af84-ca2c44d9f360 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65" status: 404 len: 111 microversion: 2.1 time: 0.033062 Apr 14 04:40:31 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 323/964] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:40:31 2023] GET /compute/v2.1/servers/695d931b-1f30-4d57-b6d7-d199d2874e65 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:40:31 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4ff0ecda-4909-4c29-b60a-64ac75e7e3f4 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c" status: 204 len: 0 microversion: 2.1 time: 0.113630 Apr 14 04:40:31 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 319/965] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:40:31 2023] DELETE /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e35b3ae371cf4dd4b21e2999e58cd2f4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c14c332dfcc44b49ddf3cb482dd0d4c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:31 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c99681c1-ff64-4c21-aa49-055d3475f8a5 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c" status: 200 len: 1543 microversion: 2.1 time: 0.215691 Apr 14 04:40:31 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 324/966] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:40:31 2023] GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c => generated 1543 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-2cdf4033-7f62-4e30-a304-006fefa2ec80 req-5ca3a284-efe6-48f0-a9d1-7e7deef2c221 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "name": "network-vif-unplugged", "status": "completed", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2cdf4033-7f62-4e30-a304-006fefa2ec80 req-5ca3a284-efe6-48f0-a9d1-7e7deef2c221 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2cdf4033-7f62-4e30-a304-006fefa2ec80 req-5ca3a284-efe6-48f0-a9d1-7e7deef2c221 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:31 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2cdf4033-7f62-4e30-a304-006fefa2ec80 req-5ca3a284-efe6-48f0-a9d1-7e7deef2c221 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2cdf4033-7f62-4e30-a304-006fefa2ec80 req-5ca3a284-efe6-48f0-a9d1-7e7deef2c221 service nova] Creating event network-vif-unplugged:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:40:31 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-2cdf4033-7f62-4e30-a304-006fefa2ec80 req-5ca3a284-efe6-48f0-a9d1-7e7deef2c221 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035137 Apr 14 04:40:31 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 324/967] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:31 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:32 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-064982e0-62a8-43b5-810a-c8d5d9c8a5a8 req-07d45e47-6bed-430d-a3cb-09c3bf6069e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "name": "network-vif-deleted", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-064982e0-62a8-43b5-810a-c8d5d9c8a5a8 req-07d45e47-6bed-430d-a3cb-09c3bf6069e2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-064982e0-62a8-43b5-810a-c8d5d9c8a5a8 req-07d45e47-6bed-430d-a3cb-09c3bf6069e2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:32 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-064982e0-62a8-43b5-810a-c8d5d9c8a5a8 req-07d45e47-6bed-430d-a3cb-09c3bf6069e2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-064982e0-62a8-43b5-810a-c8d5d9c8a5a8 req-07d45e47-6bed-430d-a3cb-09c3bf6069e2 service nova] Creating event network-vif-deleted:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:40:32 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-064982e0-62a8-43b5-810a-c8d5d9c8a5a8 req-07d45e47-6bed-430d-a3cb-09c3bf6069e2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033512 Apr 14 04:40:32 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 320/968] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:32 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:33 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-059c24e5-efeb-46cb-a6fb-f66fd9e724a0 req-c22eb9db-f5a2-489d-a70e-2b0bb8360b2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c", "name": "network-vif-plugged", "status": "completed", "tag": "bc83f476-5176-4301-8272-80034f4a0daf"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:33 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-059c24e5-efeb-46cb-a6fb-f66fd9e724a0 req-c22eb9db-f5a2-489d-a70e-2b0bb8360b2d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:33 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-059c24e5-efeb-46cb-a6fb-f66fd9e724a0 req-c22eb9db-f5a2-489d-a70e-2b0bb8360b2d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:33 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-059c24e5-efeb-46cb-a6fb-f66fd9e724a0 req-c22eb9db-f5a2-489d-a70e-2b0bb8360b2d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:33 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-059c24e5-efeb-46cb-a6fb-f66fd9e724a0 req-c22eb9db-f5a2-489d-a70e-2b0bb8360b2d service nova] Creating event network-vif-plugged:bc83f476-5176-4301-8272-80034f4a0daf for instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c on user Apr 14 04:40:33 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-059c24e5-efeb-46cb-a6fb-f66fd9e724a0 req-c22eb9db-f5a2-489d-a70e-2b0bb8360b2d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029503 Apr 14 04:40:33 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 325/969] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:33 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=12 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 3df97db3-fd6c-4be6-af32-7cde9dbcce75] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] HTTP exception thrown: Instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 could not be found. Apr 14 04:40:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Request method failure captured: Apr 14 04:40:53 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 HTTP/1.1 Apr 14 04:40:53 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:40:53 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:40:53 user devstack@n-api.service[61597]: Connection: close Apr 14 04:40:53 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:40:53 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:40:53 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:40:53 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:40:53 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONS76MWJ4n8hA--Tzr8oPchQjWfpotP5FZ97pMY97n8AJKq3YA5jlvZaD94JbBAsJYRB0panTs-KixaLHUdC5Ef50JOGpmjscfREquBX4EaKPDoPrNu3tI_9AWEeWDfC5CZY_a3w_zrzKUowXnQ9u3oX_z8zNgDHQHsS_HAugGXq1FE Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Project-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}] Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Tenant-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-User: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:40:53 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:40:53 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:40:53 user devstack@n-api.service[61597]: X-User-Id: 6ec7103e06e643a6b9b2c908ba8d7b06 Apr 14 04:40:53 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:40:53 user devstack@n-api.service[61597]: method: > Apr 14 04:40:53 user devstack@n-api.service[61597]: exception: Instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 could not be found. Apr 14 04:40:53 user devstack@n-api.service[61597]: action_args: {'id': '3df97db3-fd6c-4be6-af32-7cde9dbcce75'} Apr 14 04:40:53 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 could not be found. Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 could not be found. Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 could not be found. Apr 14 04:40:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:40:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Returning 404 to user: Instance 3df97db3-fd6c-4be6-af32-7cde9dbcce75 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:40:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-8e32ac67-0b8b-4e28-8a0a-c115a227fb88 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75" status: 404 len: 111 microversion: 2.87 time: 0.034683 Apr 14 04:40:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 325/970] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:40:52 2023] GET /compute/v2.1/servers/3df97db3-fd6c-4be6-af32-7cde9dbcce75 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:40:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-5833dd11-8967-47e4-8fb9-a7c893ed17d9 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074" status: 204 len: 0 microversion: 2.87 time: 0.144999 Apr 14 04:40:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 321/971] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:40:53 2023] DELETE /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=27,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:53 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '6ec7103e06e643a6b9b2c908ba8d7b06', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd5995b934b0546c0983387e46e3b3df4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:40:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f3825d99-17ba-4e1f-bb17-28190ba11f52 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074" status: 200 len: 1698 microversion: 2.87 time: 0.285804 Apr 14 04:40:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 326/972] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:40:53 2023] GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074 => generated 1698 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:40:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-89bc58a9-8141-49c8-ab22-0088bb9f8585 req-20203649-7559-4e44-8192-5eea584c7121 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226b0e81-b6a2-4094-b0f1-3fb0d3b94074", "name": "network-vif-unplugged", "status": "completed", "tag": "01c99489-4391-41b0-81d9-212d7e76b28c"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-89bc58a9-8141-49c8-ab22-0088bb9f8585 req-20203649-7559-4e44-8192-5eea584c7121 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-89bc58a9-8141-49c8-ab22-0088bb9f8585 req-20203649-7559-4e44-8192-5eea584c7121 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-89bc58a9-8141-49c8-ab22-0088bb9f8585 req-20203649-7559-4e44-8192-5eea584c7121 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-89bc58a9-8141-49c8-ab22-0088bb9f8585 req-20203649-7559-4e44-8192-5eea584c7121 service nova] Creating event network-vif-unplugged:01c99489-4391-41b0-81d9-212d7e76b28c for instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 on user Apr 14 04:40:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-89bc58a9-8141-49c8-ab22-0088bb9f8585 req-20203649-7559-4e44-8192-5eea584c7121 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029413 Apr 14 04:40:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 326/973] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:53 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-9b434088-8dda-40e6-9448-da9022283448 req-d7777d6a-52f8-493d-9d11-a95fad5fac34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226b0e81-b6a2-4094-b0f1-3fb0d3b94074", "name": "network-vif-deleted", "tag": "01c99489-4391-41b0-81d9-212d7e76b28c"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9b434088-8dda-40e6-9448-da9022283448 req-d7777d6a-52f8-493d-9d11-a95fad5fac34 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9b434088-8dda-40e6-9448-da9022283448 req-d7777d6a-52f8-493d-9d11-a95fad5fac34 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-9b434088-8dda-40e6-9448-da9022283448 req-d7777d6a-52f8-493d-9d11-a95fad5fac34 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-9b434088-8dda-40e6-9448-da9022283448 req-d7777d6a-52f8-493d-9d11-a95fad5fac34 service nova] Creating event network-vif-deleted:01c99489-4391-41b0-81d9-212d7e76b28c for instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 on user Apr 14 04:40:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-9b434088-8dda-40e6-9448-da9022283448 req-d7777d6a-52f8-493d-9d11-a95fad5fac34 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028541 Apr 14 04:40:54 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 322/974] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:54 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:40:55 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-c139f918-ddd2-48b1-a5d4-af4aade02076 req-c7492b30-45d2-4f55-a3da-0ddcf07c3b69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "226b0e81-b6a2-4094-b0f1-3fb0d3b94074", "name": "network-vif-plugged", "status": "completed", "tag": "01c99489-4391-41b0-81d9-212d7e76b28c"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:40:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c139f918-ddd2-48b1-a5d4-af4aade02076 req-c7492b30-45d2-4f55-a3da-0ddcf07c3b69 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:40:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c139f918-ddd2-48b1-a5d4-af4aade02076 req-c7492b30-45d2-4f55-a3da-0ddcf07c3b69 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:40:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c139f918-ddd2-48b1-a5d4-af4aade02076 req-c7492b30-45d2-4f55-a3da-0ddcf07c3b69 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:40:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-c139f918-ddd2-48b1-a5d4-af4aade02076 req-c7492b30-45d2-4f55-a3da-0ddcf07c3b69 service nova] Creating event network-vif-plugged:01c99489-4391-41b0-81d9-212d7e76b28c for instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 on user Apr 14 04:40:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-c139f918-ddd2-48b1-a5d4-af4aade02076 req-c7492b30-45d2-4f55-a3da-0ddcf07c3b69 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034904 Apr 14 04:40:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 327/975] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:40:55 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:08 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:41:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-084894f6-2925-4b45-87b2-a29ed8a2315e tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121" status: 200 len: 1442 microversion: 2.1 time: 0.175545 Apr 14 04:41:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 327/976] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:41:08 2023] GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121 => generated 1442 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:41:10 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:10 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-fdd78410-e9eb-46c4-bea3-dc4c1e2496cc req-b7479e5c-c3f6-4b57-b824-4d34d8bfffb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-fdd78410-e9eb-46c4-bea3-dc4c1e2496cc req-b7479e5c-c3f6-4b57-b824-4d34d8bfffb5 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-fdd78410-e9eb-46c4-bea3-dc4c1e2496cc req-b7479e5c-c3f6-4b57-b824-4d34d8bfffb5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-fdd78410-e9eb-46c4-bea3-dc4c1e2496cc req-b7479e5c-c3f6-4b57-b824-4d34d8bfffb5 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-fdd78410-e9eb-46c4-bea3-dc4c1e2496cc req-b7479e5c-c3f6-4b57-b824-4d34d8bfffb5 service nova] Creating event network-changed:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:41:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-fdd78410-e9eb-46c4-bea3-dc4c1e2496cc req-b7479e5c-c3f6-4b57-b824-4d34d8bfffb5 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041010 Apr 14 04:41:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 323/977] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:10 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:41:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d086675a-6290-4d70-9c71-f2762313b8cd tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121" status: 204 len: 0 microversion: 2.1 time: 0.114625 Apr 14 04:41:10 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 328/978] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:41:10 2023] DELETE /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:11 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:41:11 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e9198cba-67aa-43bf-94ef-29ef903e68a2 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121" status: 200 len: 1567 microversion: 2.1 time: 0.262001 Apr 14 04:41:11 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 328/979] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:41:10 2023] GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121 => generated 1567 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:41:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-2346b874-4e93-4387-aa29-25ceb406b250 req-3f239bc3-4e28-4e3b-988f-cf3add4df1a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "name": "network-vif-unplugged", "status": "completed", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2346b874-4e93-4387-aa29-25ceb406b250 req-3f239bc3-4e28-4e3b-988f-cf3add4df1a6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2346b874-4e93-4387-aa29-25ceb406b250 req-3f239bc3-4e28-4e3b-988f-cf3add4df1a6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-2346b874-4e93-4387-aa29-25ceb406b250 req-3f239bc3-4e28-4e3b-988f-cf3add4df1a6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-2346b874-4e93-4387-aa29-25ceb406b250 req-3f239bc3-4e28-4e3b-988f-cf3add4df1a6 service nova] Creating event network-vif-unplugged:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:41:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-2346b874-4e93-4387-aa29-25ceb406b250 req-3f239bc3-4e28-4e3b-988f-cf3add4df1a6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032045 Apr 14 04:41:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 324/980] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:11 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:12 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-2df29ad9-e134-465f-b5ec-a084a5d922c1 req-51b173ad-cc88-459d-b734-eb01ec9f1c58 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2df29ad9-e134-465f-b5ec-a084a5d922c1 req-51b173ad-cc88-459d-b734-eb01ec9f1c58 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2df29ad9-e134-465f-b5ec-a084a5d922c1 req-51b173ad-cc88-459d-b734-eb01ec9f1c58 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:12 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2df29ad9-e134-465f-b5ec-a084a5d922c1 req-51b173ad-cc88-459d-b734-eb01ec9f1c58 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2df29ad9-e134-465f-b5ec-a084a5d922c1 req-51b173ad-cc88-459d-b734-eb01ec9f1c58 service nova] Creating event network-changed:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:41:12 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-2df29ad9-e134-465f-b5ec-a084a5d922c1 req-51b173ad-cc88-459d-b734-eb01ec9f1c58 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028151 Apr 14 04:41:12 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 329/981] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a2d1b32b-c153-424d-8738-17b715b97911 req-0dfeb969-f026-4a84-b422-4b7f66028761 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "name": "network-vif-deleted", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a2d1b32b-c153-424d-8738-17b715b97911 req-0dfeb969-f026-4a84-b422-4b7f66028761 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a2d1b32b-c153-424d-8738-17b715b97911 req-0dfeb969-f026-4a84-b422-4b7f66028761 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a2d1b32b-c153-424d-8738-17b715b97911 req-0dfeb969-f026-4a84-b422-4b7f66028761 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a2d1b32b-c153-424d-8738-17b715b97911 req-0dfeb969-f026-4a84-b422-4b7f66028761 service nova] Creating event network-vif-deleted:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:41:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a2d1b32b-c153-424d-8738-17b715b97911 req-0dfeb969-f026-4a84-b422-4b7f66028761 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036241 Apr 14 04:41:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 329/982] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:12 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:41:13 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 HTTP/1.1 Apr 14 04:41:13 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:41:13 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:41:13 user devstack@n-api.service[61595]: Connection: close Apr 14 04:41:13 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:41:13 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:41:13 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:41:13 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:41:13 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:41:13 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:41:13 user devstack@n-api.service[61595]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:41:13 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:41:13 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:41:13 user devstack@n-api.service[61595]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:41:13 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:41:13 user devstack@n-api.service[61595]: method: > Apr 14 04:41:13 user devstack@n-api.service[61595]: exception: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:41:13 user devstack@n-api.service[61595]: action_args: {'id': '283ef25b-314a-47c1-8414-9d7c737e5115'} Apr 14 04:41:13 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:41:13 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-41917f16-78a3-4a90-9ecd-e9f279a800d8 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115" status: 404 len: 111 microversion: 2.1 time: 0.028754 Apr 14 04:41:13 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 325/983] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:41:13 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:41:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5a616827-8aff-4ce9-863e-68aafade83bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '.version_select at 0x7f538ae17a30>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5a616827-8aff-4ce9-863e-68aafade83bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-499854002" status: 202 len: 0 microversion: 2.1 time: 0.023551 Apr 14 04:41:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 330/984] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 04:41:13 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-499854002 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:41:13 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-ab11b844-287c-47c9-ac45-94e25116a976 req-73a8480c-6e3c-4314-8fd1-b7d509f9cab6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d93dc7e-d497-4d8f-9ade-c508170f6121", "name": "network-vif-plugged", "status": "completed", "tag": "2fcf791e-22d7-4a96-894c-70900772a5ff"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ab11b844-287c-47c9-ac45-94e25116a976 req-73a8480c-6e3c-4314-8fd1-b7d509f9cab6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ab11b844-287c-47c9-ac45-94e25116a976 req-73a8480c-6e3c-4314-8fd1-b7d509f9cab6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:13 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-ab11b844-287c-47c9-ac45-94e25116a976 req-73a8480c-6e3c-4314-8fd1-b7d509f9cab6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-ab11b844-287c-47c9-ac45-94e25116a976 req-73a8480c-6e3c-4314-8fd1-b7d509f9cab6 service nova] Creating event network-vif-plugged:2fcf791e-22d7-4a96-894c-70900772a5ff for instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 on user Apr 14 04:41:13 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-ab11b844-287c-47c9-ac45-94e25116a976 req-73a8480c-6e3c-4314-8fd1-b7d509f9cab6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032337 Apr 14 04:41:13 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 330/985] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:13 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-389ac8a9-9b35-4774-b0b0-36eae5b51b00 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: .version_select at 0x7f538aceab90>, body: {"keypair": {"name": "tempest-keypair-2017831093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC3TphBlHcrFQUWfHI9Rd+a22lD9cX0GeecKjEQEW/ftTRl57yNsm3ZsNJGGAxbXJX4cCwx+4dgcJcdGA6/AzTSvdleEod5ijJD25/l5NF3G7sPYAP/bwHLaLqv+XnXDSQ=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-389ac8a9-9b35-4774-b0b0-36eae5b51b00 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:41:13 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-389ac8a9-9b35-4774-b0b0-36eae5b51b00 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:41:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-389ac8a9-9b35-4774-b0b0-36eae5b51b00 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051031 Apr 14 04:41:13 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 326/986] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:41:13 2023] POST /compute/v2.1/os-keypairs => generated 386 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-610195412", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f58d1c12-4d40-40b9-93c5-2db82486289a"}], "security_groups": [{"name": "tempest-securitygroup--1905878407"}], "key_name": "tempest-keypair-2017831093", "user_data": "}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] validate_networks() for [('f58d1c12-4d40-40b9-93c5-2db82486289a', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:41:15 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:41:15 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-58c09e33-2c04-4e2c-ba75-9fb21c30d050 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.583359 Apr 14 04:41:15 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 331/987] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:41:15 2023] POST /compute/v2.1/servers => generated 400 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:41:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e5cdb1cb-9f63-4bc3-93f0-04066e8e6105 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:15 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e5cdb1cb-9f63-4bc3-93f0-04066e8e6105 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:15 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e5cdb1cb-9f63-4bc3-93f0-04066e8e6105 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:41:15 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e5cdb1cb-9f63-4bc3-93f0-04066e8e6105 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca" status: 200 len: 1235 microversion: 2.1 time: 0.079580 Apr 14 04:41:15 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 331/988] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:41:15 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca => generated 1235 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:41:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-a33ac9c4-486d-4771-9d69-23b58d22507e req-3186419d-b374-4fed-ad26-37acc9e9c96c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8009dc-c463-41f2-8b36-21862b7ad5ca", "tag": "6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-a33ac9c4-486d-4771-9d69-23b58d22507e req-3186419d-b374-4fed-ad26-37acc9e9c96c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-a33ac9c4-486d-4771-9d69-23b58d22507e req-3186419d-b374-4fed-ad26-37acc9e9c96c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-a33ac9c4-486d-4771-9d69-23b58d22507e req-3186419d-b374-4fed-ad26-37acc9e9c96c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-a33ac9c4-486d-4771-9d69-23b58d22507e req-3186419d-b374-4fed-ad26-37acc9e9c96c service nova] Creating event network-changed:6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68 for instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca on user Apr 14 04:41:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-a33ac9c4-486d-4771-9d69-23b58d22507e req-3186419d-b374-4fed-ad26-37acc9e9c96c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028336 Apr 14 04:41:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 327/989] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:18 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-58a9cffa-dd59-4076-926f-09db4fe494b8 req-d05fb58c-ee07-427a-9be2-7cac9d135449 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8009dc-c463-41f2-8b36-21862b7ad5ca", "name": "network-vif-plugged", "status": "completed", "tag": "6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-58a9cffa-dd59-4076-926f-09db4fe494b8 req-d05fb58c-ee07-427a-9be2-7cac9d135449 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-58a9cffa-dd59-4076-926f-09db4fe494b8 req-d05fb58c-ee07-427a-9be2-7cac9d135449 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-58a9cffa-dd59-4076-926f-09db4fe494b8 req-d05fb58c-ee07-427a-9be2-7cac9d135449 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-58a9cffa-dd59-4076-926f-09db4fe494b8 req-d05fb58c-ee07-427a-9be2-7cac9d135449 service nova] Creating event network-vif-plugged:6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68 for instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca on user Apr 14 04:41:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-58a9cffa-dd59-4076-926f-09db4fe494b8 req-d05fb58c-ee07-427a-9be2-7cac9d135449 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028127 Apr 14 04:41:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 332/990] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:20 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c could not be found. Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:41:21 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c HTTP/1.1 Apr 14 04:41:21 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:41:21 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:41:21 user devstack@n-api.service[61597]: Connection: close Apr 14 04:41:21 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:41:21 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:41:21 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:41:21 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:41:21 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:41:21 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:21 user devstack@n-api.service[61597]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:41:21 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:41:21 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:41:21 user devstack@n-api.service[61597]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:41:21 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:41:21 user devstack@n-api.service[61597]: method: > Apr 14 04:41:21 user devstack@n-api.service[61597]: exception: Instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c could not be found. Apr 14 04:41:21 user devstack@n-api.service[61597]: action_args: {'id': '123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c'} Apr 14 04:41:21 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c could not be found. Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c could not be found. Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c could not be found. Apr 14 04:41:21 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:21 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance 123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-91609fb4-5ac5-47a9-bbd8-c6a2440f3aa9 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c" status: 404 len: 111 microversion: 2.1 time: 0.028137 Apr 14 04:41:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 332/991] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:41:21 2023] GET /compute/v2.1/servers/123cbab6-0dcc-4f1c-a6c0-89eed5b41b7c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:41:22 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0a141052-1679-43da-b395-70bc67ee60b4 req-31df3052-f616-4811-b9fa-350de31e3a3d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8009dc-c463-41f2-8b36-21862b7ad5ca", "name": "network-vif-plugged", "status": "completed", "tag": "6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0a141052-1679-43da-b395-70bc67ee60b4 req-31df3052-f616-4811-b9fa-350de31e3a3d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0a141052-1679-43da-b395-70bc67ee60b4 req-31df3052-f616-4811-b9fa-350de31e3a3d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:22 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0a141052-1679-43da-b395-70bc67ee60b4 req-31df3052-f616-4811-b9fa-350de31e3a3d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0a141052-1679-43da-b395-70bc67ee60b4 req-31df3052-f616-4811-b9fa-350de31e3a3d service nova] Creating event network-vif-plugged:6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68 for instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca on user Apr 14 04:41:22 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0a141052-1679-43da-b395-70bc67ee60b4 req-31df3052-f616-4811-b9fa-350de31e3a3d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029219 Apr 14 04:41:22 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 328/992] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:41:22 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:41:28 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d HTTP/1.1 Apr 14 04:41:28 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:41:28 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:41:28 user devstack@n-api.service[61596]: Connection: close Apr 14 04:41:28 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:41:28 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:41:28 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:41:28 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:41:28 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:41:28 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:28 user devstack@n-api.service[61596]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:41:28 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:41:28 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:41:28 user devstack@n-api.service[61596]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:41:28 user devstack@n-api.service[61596]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:41:28 user devstack@n-api.service[61596]: method: > Apr 14 04:41:28 user devstack@n-api.service[61596]: exception: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61596]: action_args: {'id': 'a0a20aeb-ed06-4c65-b87d-74f8f825457d'} Apr 14 04:41:28 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-f8cadc34-e936-42fc-8ef8-39c438a7f5d2 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 404 len: 111 microversion: 2.1 time: 0.035838 Apr 14 04:41:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 333/993] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:41:28 2023] DELETE /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] [instance: a0a20aeb-ed06-4c65-b87d-74f8f825457d] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] HTTP exception thrown: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Request method failure captured: Apr 14 04:41:28 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d HTTP/1.1 Apr 14 04:41:28 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:41:28 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:41:28 user devstack@n-api.service[61597]: Connection: close Apr 14 04:41:28 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:41:28 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:41:28 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:41:28 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:41:28 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONOeBrZMrZo3gZhOmx8zn99MbHYDouFzeAqA-_eStqfAKGrqqE1_RE7XaxvdqlS5kpCX_kjpVGDEnP29I-qmkv_1bQI22uqloChXlsgnIxjAO0M1ervTPOdozgw7UB0ksZBjT0G3o165PfK20DM4-tPJtEcd1uL3qiddbQgHGOuY8Kw Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Project-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Project-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/8c14c332dfcc44b49ddf3cb482dd0d4c"}]}] Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Tenant: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Tenant-Id: 8c14c332dfcc44b49ddf3cb482dd0d4c Apr 14 04:41:28 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-ServerActionsTestJSON-1048786641 Apr 14 04:41:28 user devstack@n-api.service[61597]: X-User: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:41:28 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:41:28 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:41:28 user devstack@n-api.service[61597]: X-User-Id: e35b3ae371cf4dd4b21e2999e58cd2f4 Apr 14 04:41:28 user devstack@n-api.service[61597]: X-User-Name: tempest-ServerActionsTestJSON-1048786641-project-member Apr 14 04:41:28 user devstack@n-api.service[61597]: method: > Apr 14 04:41:28 user devstack@n-api.service[61597]: exception: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61597]: action_args: {'id': 'a0a20aeb-ed06-4c65-b87d-74f8f825457d'} Apr 14 04:41:28 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. Apr 14 04:41:28 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Returning 404 to user: Instance a0a20aeb-ed06-4c65-b87d-74f8f825457d could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2efc9165-42c0-457c-adac-d4691b710b8c tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d" status: 404 len: 111 microversion: 2.1 time: 0.033832 Apr 14 04:41:28 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 333/994] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:41:28 2023] GET /compute/v2.1/servers/a0a20aeb-ed06-4c65-b87d-74f8f825457d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Apr 14 04:41:28 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:28 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-6c4f7906-5d33-4781-9c24-f34e9d23d768 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] Calling method '.version_select at 0x7f538820e9e0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:28 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-6c4f7906-5d33-4781-9c24-f34e9d23d768 tempest-ServerActionsTestJSON-1048786641 tempest-ServerActionsTestJSON-1048786641-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-964114001" status: 202 len: 0 microversion: 2.1 time: 0.027186 Apr 14 04:41:28 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 329/995] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 04:41:28 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-964114001 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:41:34 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Action: 'create', calling method: .version_select at 0x7f538aad13f0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-899640550"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:34 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-351f74a7-31ab-41e4-b83d-9e18a6fcf546 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.492005 Apr 14 04:41:34 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 334/996] 10.0.0.210 () {64 vars in 1232 bytes} [Fri Apr 14 04:41:34 2023] POST /compute/v2.1/os-volumes => generated 344 bytes in 493 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 04:41:34 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-618080f4-9a7f-4edf-9e9d-2df7b5dc4ed2 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538acb6b90>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:34 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-618080f4-9a7f-4edf-9e9d-2df7b5dc4ed2 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 200 len: 344 microversion: 2.1 time: 0.065281 Apr 14 04:41:34 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 334/997] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:34 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 344 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:35 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=10 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:35 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b2159850-8c62-4712-bb7f-c2b71ed66a59 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538820d510>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:36 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b2159850-8c62-4712-bb7f-c2b71ed66a59 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 200 len: 344 microversion: 2.1 time: 0.076809 Apr 14 04:41:36 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 330/998] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:35 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 344 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:37 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c6393ad4-1e57-4d74-bae0-21e33e63415a tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538a942a70>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c6393ad4-1e57-4d74-bae0-21e33e63415a tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 200 len: 345 microversion: 2.1 time: 0.052366 Apr 14 04:41:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 335/999] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:37 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 345 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-0817196f-65ea-4c6e-9ca3-7daeb33d051c tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Action: 'create', calling method: .version_select at 0x7f538aed7130>, body: {"snapshot": {"volume_id": "5dbd1e7d-3f46-4104-a106-e273736f0b89", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-518519668"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-0817196f-65ea-4c6e-9ca3-7daeb33d051c tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.179466 Apr 14 04:41:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 335/1000] 10.0.0.210 () {64 vars in 1239 bytes} [Fri Apr 14 04:41:37 2023] POST /compute/v2.1/os-snapshots => generated 286 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:41:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f1c34667-6314-4a3c-b40d-bf2f37520721 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538820e8c0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f1c34667-6314-4a3c-b40d-bf2f37520721 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 200 len: 286 microversion: 2.1 time: 0.046995 Apr 14 04:41:37 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 331/1001] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:37 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:37 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5bb5d384-12d9-4efc-9a12-df3de01dc461 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538b0f4ca0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5bb5d384-12d9-4efc-9a12-df3de01dc461 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.056738 Apr 14 04:41:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 336/1002] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 04:41:37 2023] GET /compute/v2.1/os-snapshots => generated 289 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a898cd92-621e-40ff-919d-6a444bd0b039 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538aed49d0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a898cd92-621e-40ff-919d-6a444bd0b039 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 200 len: 286 microversion: 2.1 time: 0.034166 Apr 14 04:41:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 336/1003] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:37 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:38 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d2cd0b77-024e-45c6-96c7-ac0d5bc77bf2 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538acea200>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:38 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d2cd0b77-024e-45c6-96c7-ac0d5bc77bf2 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 200 len: 286 microversion: 2.1 time: 0.033122 Apr 14 04:41:38 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 332/1004] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:38 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:39 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=23,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:39 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a1374b78-4087-4085-965a-3d20427cdb75 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538aad2560>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:39 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a1374b78-4087-4085-965a-3d20427cdb75 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 200 len: 287 microversion: 2.1 time: 0.041750 Apr 14 04:41:39 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 337/1005] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:39 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 287 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=16 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:39 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=20 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:39 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e1284439-c5a8-418f-b01d-6c51c6edbe7c tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538acb43a0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:39 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e1284439-c5a8-418f-b01d-6c51c6edbe7c tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 202 len: 0 microversion: 2.1 time: 0.063153 Apr 14 04:41:39 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 337/1006] 10.0.0.210 () {62 vars in 1331 bytes} [Fri Apr 14 04:41:39 2023] DELETE /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 0 bytes in 64 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:41:39 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:39 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-d1186e08-f001-4164-bd52-723ade34857f tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538820dfc0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:39 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-d1186e08-f001-4164-bd52-723ade34857f tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 200 len: 286 microversion: 2.1 time: 0.037117 Apr 14 04:41:39 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 333/1007] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:39 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:40 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b0c456c1-797c-4955-92c8-067274b5d6b1 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538ad1d870>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:40 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b0c456c1-797c-4955-92c8-067274b5d6b1 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 200 len: 286 microversion: 2.1 time: 0.036961 Apr 14 04:41:40 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 338/1008] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:40 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 286 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:41 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a6845d90-c897-4839-b7b3-46a095452313 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538acb5d80>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:41 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a6845d90-c897-4839-b7b3-46a095452313 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 200 len: 286 microversion: 2.1 time: 0.033962 Apr 14 04:41:41 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 338/1009] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:41 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 286 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:42 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1c508dfd-5d13-4e4a-b686-11916128bab3 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538820c8b0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-1c508dfd-5d13-4e4a-b686-11916128bab3 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] HTTP exception thrown: Snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 could not be found. Apr 14 04:41:42 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1c508dfd-5d13-4e4a-b686-11916128bab3 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Request method failure captured: Apr 14 04:41:42 user devstack@n-api.service[61595]: request: GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 HTTP/1.1 Apr 14 04:41:42 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:41:42 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:41:42 user devstack@n-api.service[61595]: Connection: close Apr 14 04:41:42 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:41:42 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:41:42 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:41:42 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:41:42 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONl-m7uFoyjL42L5Yojl2VXptoEils6D2LlD3UDomP90u25NYeU7UxirBfEoRIL5hDvPDim4zoA5kugVv9rM6n4OZQaqWciPvtOyOFL3qJy7FEeT5GZpR2HH_E0MTqrssann6GTxLKDGFXSYv5c4tmmCKAZe0wYgeufGF3awRemXmew Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Project-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}] Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Tenant-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:42 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:42 user devstack@n-api.service[61595]: X-User: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:42 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:41:42 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:41:42 user devstack@n-api.service[61595]: X-User-Id: 3a142e520a2045a5b01a8638e62fcbef Apr 14 04:41:42 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:42 user devstack@n-api.service[61595]: method: Apr 14 04:41:42 user devstack@n-api.service[61595]: exception: Snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 could not be found. Apr 14 04:41:42 user devstack@n-api.service[61595]: action_args: {'id': '6c294099-f4f2-4a87-bf5b-cdff61927080'} Apr 14 04:41:42 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 could not be found. (HTTP 404) (Request-ID: req-30cfbcba-b5a0-460c-b928-932b62af8f33) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volume_snapshots.py", line 174, in get Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 could not be found. Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 could not be found. Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 could not be found. Apr 14 04:41:42 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:42 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1c508dfd-5d13-4e4a-b686-11916128bab3 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Returning 404 to user: Snapshot 6c294099-f4f2-4a87-bf5b-cdff61927080 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:42 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1c508dfd-5d13-4e4a-b686-11916128bab3 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080" status: 404 len: 111 microversion: 2.1 time: 0.038766 Apr 14 04:41:42 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 334/1010] 10.0.0.210 () {62 vars in 1328 bytes} [Fri Apr 14 04:41:42 2023] GET /compute/v2.1/os-snapshots/6c294099-f4f2-4a87-bf5b-cdff61927080 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:41:42 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1e6446d0-8272-4846-a3fd-633c74667aa6 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538aad0940>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:42 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1e6446d0-8272-4846-a3fd-633c74667aa6 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 202 len: 0 microversion: 2.1 time: 0.143323 Apr 14 04:41:42 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 339/1011] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:41:42 2023] DELETE /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 0 bytes in 145 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:41:42 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-aec589d1-6738-493e-ad8e-67e2e04a87b7 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538acb7010>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:42 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-aec589d1-6738-493e-ad8e-67e2e04a87b7 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 200 len: 344 microversion: 2.1 time: 0.052852 Apr 14 04:41:42 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 339/1012] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:42 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] [instance: 226b0e81-b6a2-4094-b0f1-3fb0d3b94074] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:41:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] HTTP exception thrown: Instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 could not be found. Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Request method failure captured: Apr 14 04:41:43 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074 HTTP/1.1 Apr 14 04:41:43 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:41:43 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:41:43 user devstack@n-api.service[61595]: Connection: close Apr 14 04:41:43 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:41:43 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:41:43 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:41:43 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:41:43 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONS76MWJ4n8hA--Tzr8oPchQjWfpotP5FZ97pMY97n8AJKq3YA5jlvZaD94JbBAsJYRB0panTs-KixaLHUdC5Ef50JOGpmjscfREquBX4EaKPDoPrNu3tI_9AWEeWDfC5CZY_a3w_zrzKUowXnQ9u3oX_z8zNgDHQHsS_HAugGXq1FE Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.87 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Project-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Project-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/d5995b934b0546c0983387e46e3b3df4"}]}] Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Tenant: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Tenant-Id: d5995b934b0546c0983387e46e3b3df4 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-User: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:41:43 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:41:43 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:41:43 user devstack@n-api.service[61595]: X-User-Id: 6ec7103e06e643a6b9b2c908ba8d7b06 Apr 14 04:41:43 user devstack@n-api.service[61595]: X-User-Name: tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member Apr 14 04:41:43 user devstack@n-api.service[61595]: method: > Apr 14 04:41:43 user devstack@n-api.service[61595]: exception: Instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 could not be found. Apr 14 04:41:43 user devstack@n-api.service[61595]: action_args: {'id': '226b0e81-b6a2-4094-b0f1-3fb0d3b94074'} Apr 14 04:41:43 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 could not be found. Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 could not be found. Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 could not be found. Apr 14 04:41:43 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:43 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] Returning 404 to user: Instance 226b0e81-b6a2-4094-b0f1-3fb0d3b94074 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:43 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-fe2ec2bb-942d-4091-8740-14b973d06bf1 tempest-ServerBootFromVolumeStableRescueTest-247821842 tempest-ServerBootFromVolumeStableRescueTest-247821842-project-member] 10.0.0.210 "GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074" status: 404 len: 111 microversion: 2.87 time: 0.171504 Apr 14 04:41:43 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 335/1013] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:41:43 2023] GET /compute/v2.1/servers/226b0e81-b6a2-4094-b0f1-3fb0d3b94074 => generated 111 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:41:44 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-81812878-d7d0-4c23-a239-488b5135898c tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538ad1e0e0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:44 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-81812878-d7d0-4c23-a239-488b5135898c tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 200 len: 344 microversion: 2.1 time: 0.065773 Apr 14 04:41:44 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 340/1014] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:44 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 344 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:45 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e4d9cde5-77ed-4eee-a0f7-9993dba19865 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538af1f130>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:45 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e4d9cde5-77ed-4eee-a0f7-9993dba19865 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 200 len: 344 microversion: 2.1 time: 0.058509 Apr 14 04:41:45 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 340/1015] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:45 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 344 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:41:46 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ca3e2a49-9d1f-4b42-b71c-08ff17f9f451 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538acea200>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-ca3e2a49-9d1f-4b42-b71c-08ff17f9f451 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] HTTP exception thrown: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ca3e2a49-9d1f-4b42-b71c-08ff17f9f451 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Request method failure captured: Apr 14 04:41:46 user devstack@n-api.service[61595]: request: GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 HTTP/1.1 Apr 14 04:41:46 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:41:46 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:41:46 user devstack@n-api.service[61595]: Connection: close Apr 14 04:41:46 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:41:46 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:41:46 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:41:46 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:41:46 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONl-m7uFoyjL42L5Yojl2VXptoEils6D2LlD3UDomP90u25NYeU7UxirBfEoRIL5hDvPDim4zoA5kugVv9rM6n4OZQaqWciPvtOyOFL3qJy7FEeT5GZpR2HH_E0MTqrssann6GTxLKDGFXSYv5c4tmmCKAZe0wYgeufGF3awRemXmew Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Project-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}] Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Tenant-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:46 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61595]: X-User: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:46 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:41:46 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:41:46 user devstack@n-api.service[61595]: X-User-Id: 3a142e520a2045a5b01a8638e62fcbef Apr 14 04:41:46 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:46 user devstack@n-api.service[61595]: method: Apr 14 04:41:46 user devstack@n-api.service[61595]: exception: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61595]: action_args: {'id': '5dbd1e7d-3f46-4104-a106-e273736f0b89'} Apr 14 04:41:46 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. (HTTP 404) (Request-ID: req-141f11b2-e2cf-41ff-a608-df4b7d88cc13) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ca3e2a49-9d1f-4b42-b71c-08ff17f9f451 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Returning 404 to user: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ca3e2a49-9d1f-4b42-b71c-08ff17f9f451 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 404 len: 109 microversion: 2.1 time: 0.060113 Apr 14 04:41:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 336/1016] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:46 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 109 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:41:46 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c24df36e-cd2a-485d-bd4f-a04dc33bc1ba tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538aad30a0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-c24df36e-cd2a-485d-bd4f-a04dc33bc1ba tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] HTTP exception thrown: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c24df36e-cd2a-485d-bd4f-a04dc33bc1ba tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Request method failure captured: Apr 14 04:41:46 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 HTTP/1.1 Apr 14 04:41:46 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:41:46 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:41:46 user devstack@n-api.service[61596]: Connection: close Apr 14 04:41:46 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:41:46 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:41:46 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:41:46 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:41:46 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONl-m7uFoyjL42L5Yojl2VXptoEils6D2LlD3UDomP90u25NYeU7UxirBfEoRIL5hDvPDim4zoA5kugVv9rM6n4OZQaqWciPvtOyOFL3qJy7FEeT5GZpR2HH_E0MTqrssann6GTxLKDGFXSYv5c4tmmCKAZe0wYgeufGF3awRemXmew Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Project-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}] Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Tenant-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:46 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61596]: X-User: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:46 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:41:46 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:41:46 user devstack@n-api.service[61596]: X-User-Id: 3a142e520a2045a5b01a8638e62fcbef Apr 14 04:41:46 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:46 user devstack@n-api.service[61596]: method: Apr 14 04:41:46 user devstack@n-api.service[61596]: exception: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61596]: action_args: {'id': '5dbd1e7d-3f46-4104-a106-e273736f0b89'} Apr 14 04:41:46 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. (HTTP 404) (Request-ID: req-ebd13723-1489-4e8e-8ae4-9a6b7152557b) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c24df36e-cd2a-485d-bd4f-a04dc33bc1ba tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Returning 404 to user: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c24df36e-cd2a-485d-bd4f-a04dc33bc1ba tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 404 len: 109 microversion: 2.1 time: 0.037783 Apr 14 04:41:46 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 341/1017] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:41:46 2023] DELETE /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:41:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-283c9692-bf7c-4b40-9bef-46c5b09d8309 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Calling method '.version_select at 0x7f538b2e4430>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:41:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-283c9692-bf7c-4b40-9bef-46c5b09d8309 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] HTTP exception thrown: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-283c9692-bf7c-4b40-9bef-46c5b09d8309 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Request method failure captured: Apr 14 04:41:46 user devstack@n-api.service[61597]: request: GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 HTTP/1.1 Apr 14 04:41:46 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:41:46 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:41:46 user devstack@n-api.service[61597]: Connection: close Apr 14 04:41:46 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:41:46 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:41:46 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:41:46 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:41:46 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONl-m7uFoyjL42L5Yojl2VXptoEils6D2LlD3UDomP90u25NYeU7UxirBfEoRIL5hDvPDim4zoA5kugVv9rM6n4OZQaqWciPvtOyOFL3qJy7FEeT5GZpR2HH_E0MTqrssann6GTxLKDGFXSYv5c4tmmCKAZe0wYgeufGF3awRemXmew Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Project-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/dc7cbf8498c84ac2b57bf415afdf77fa"}]}] Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Tenant: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Tenant-Id: dc7cbf8498c84ac2b57bf415afdf77fa Apr 14 04:41:46 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-491060007 Apr 14 04:41:46 user devstack@n-api.service[61597]: X-User: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:46 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:41:46 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:41:46 user devstack@n-api.service[61597]: X-User-Id: 3a142e520a2045a5b01a8638e62fcbef Apr 14 04:41:46 user devstack@n-api.service[61597]: X-User-Name: tempest-VolumesSnapshotsTestJSON-491060007-project-member Apr 14 04:41:46 user devstack@n-api.service[61597]: method: Apr 14 04:41:46 user devstack@n-api.service[61597]: exception: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61597]: action_args: {'id': '5dbd1e7d-3f46-4104-a106-e273736f0b89'} Apr 14 04:41:46 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. (HTTP 404) (Request-ID: req-d1504b54-855e-4059-91df-4af956e1e66e) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. Apr 14 04:41:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:41:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-283c9692-bf7c-4b40-9bef-46c5b09d8309 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] Returning 404 to user: Volume 5dbd1e7d-3f46-4104-a106-e273736f0b89 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:41:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-283c9692-bf7c-4b40-9bef-46c5b09d8309 tempest-VolumesSnapshotsTestJSON-491060007 tempest-VolumesSnapshotsTestJSON-491060007-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89" status: 404 len: 109 microversion: 2.1 time: 0.050155 Apr 14 04:41:46 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 341/1018] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:41:46 2023] GET /compute/v2.1/os-volumes/5dbd1e7d-3f46-4104-a106-e273736f0b89 => generated 109 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:41:57 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:57 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:41:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ff6a6078-3c2f-40b7-bc0c-bbbb70fba983 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'create', calling method: .version_select at 0x7f538835c790>, body: {"keypair": {"name": "tempest-keypair-1996810505", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH6fraox0ufDVlTeIxqf3LA1Jqk/6GB3uKQGBsTlrxVUqCfAkV+hrTL0aqpPNJ0Y4OrCsZ9AqcY4PXRY4CmEWIke2qyPR134zIiDdDnr3VeL889NFNXZb2Fua8pApWkvww=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:57 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-ff6a6078-3c2f-40b7-bc0c-bbbb70fba983 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:41:57 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-ff6a6078-3c2f-40b7-bc0c-bbbb70fba983 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for user 67d6c699fc524554a6f4983af91d58fc and project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:41:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ff6a6078-3c2f-40b7-bc0c-bbbb70fba983 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.193480 Apr 14 04:41:57 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 337/1019] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 04:41:57 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 195 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 04:41:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1249800375", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4c4f373b-6540-48ea-815b-d4930f403496"}], "security_groups": [{"name": "tempest-securitygroup--224766529"}], "key_name": "tempest-keypair-1996810505", "user_data": "}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:41:59 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] validate_networks() for [('4c4f373b-6540-48ea-815b-d4930f403496', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for user 67d6c699fc524554a6f4983af91d58fc and project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:42:00 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:42:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-de3873ba-256d-48aa-bde0-98ca7ca1164f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 1.333492 Apr 14 04:42:00 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 342/1020] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 04:41:59 2023] POST /compute/v2.1/servers => generated 399 bytes in 1335 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:42:00 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e45141a4-d512-4190-b1a6-25cea6008b53 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:00 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e45141a4-d512-4190-b1a6-25cea6008b53 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:00 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e45141a4-d512-4190-b1a6-25cea6008b53 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:00 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e45141a4-d512-4190-b1a6-25cea6008b53 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:00 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-e45141a4-d512-4190-b1a6-25cea6008b53 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:00 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e45141a4-d512-4190-b1a6-25cea6008b53 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 200 len: 1276 microversion: 2.20 time: 0.218768 Apr 14 04:42:00 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 342/1021] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:42:00 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 1276 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 9d93dc7e-d497-4d8f-9ade-c508170f6121] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 could not be found. Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:42:01 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121 HTTP/1.1 Apr 14 04:42:01 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:42:01 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:42:01 user devstack@n-api.service[61595]: Connection: close Apr 14 04:42:01 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:42:01 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:42:01 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:42:01 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:42:01 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:42:01 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:01 user devstack@n-api.service[61595]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:42:01 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:42:01 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:42:01 user devstack@n-api.service[61595]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:42:01 user devstack@n-api.service[61595]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:42:01 user devstack@n-api.service[61595]: method: > Apr 14 04:42:01 user devstack@n-api.service[61595]: exception: Instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 could not be found. Apr 14 04:42:01 user devstack@n-api.service[61595]: action_args: {'id': '9d93dc7e-d497-4d8f-9ade-c508170f6121'} Apr 14 04:42:01 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 could not be found. Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 could not be found. Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 could not be found. Apr 14 04:42:01 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:42:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance 9d93dc7e-d497-4d8f-9ade-c508170f6121 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:42:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-20a77ab5-4034-4848-9da8-75e37e91bf09 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121" status: 404 len: 111 microversion: 2.1 time: 0.146505 Apr 14 04:42:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 338/1022] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:42:01 2023] GET /compute/v2.1/servers/9d93dc7e-d497-4d8f-9ade-c508170f6121 => generated 111 bytes in 148 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:42:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-63eea503-5cd4-4f59-8209-dcb2f304d607 req-ed4024d8-8b7f-41ea-9992-8a53b6179384 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-63eea503-5cd4-4f59-8209-dcb2f304d607 req-ed4024d8-8b7f-41ea-9992-8a53b6179384 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-63eea503-5cd4-4f59-8209-dcb2f304d607 req-ed4024d8-8b7f-41ea-9992-8a53b6179384 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:02 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-63eea503-5cd4-4f59-8209-dcb2f304d607 req-ed4024d8-8b7f-41ea-9992-8a53b6179384 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-63eea503-5cd4-4f59-8209-dcb2f304d607 req-ed4024d8-8b7f-41ea-9992-8a53b6179384 service nova] Creating event network-changed:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:42:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-63eea503-5cd4-4f59-8209-dcb2f304d607 req-ed4024d8-8b7f-41ea-9992-8a53b6179384 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037110 Apr 14 04:42:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 343/1023] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:02 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a3ad2674-35d1-4c68-9d3b-f5ae3130c423 req-f810c284-dd39-4b07-96cb-bc11cda9873d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-plugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a3ad2674-35d1-4c68-9d3b-f5ae3130c423 req-f810c284-dd39-4b07-96cb-bc11cda9873d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a3ad2674-35d1-4c68-9d3b-f5ae3130c423 req-f810c284-dd39-4b07-96cb-bc11cda9873d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a3ad2674-35d1-4c68-9d3b-f5ae3130c423 req-f810c284-dd39-4b07-96cb-bc11cda9873d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a3ad2674-35d1-4c68-9d3b-f5ae3130c423 req-f810c284-dd39-4b07-96cb-bc11cda9873d service nova] Creating event network-vif-plugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:42:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a3ad2674-35d1-4c68-9d3b-f5ae3130c423 req-f810c284-dd39-4b07-96cb-bc11cda9873d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092732 Apr 14 04:42:05 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 343/1024] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:05 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:06 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:06 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2384b351-797a-4a97-90eb-b406673b14f0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca" status: 200 len: 1544 microversion: 2.1 time: 0.429574 Apr 14 04:42:06 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 339/1025] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:42:06 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca => generated 1544 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:42:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-b7b06080-7c3f-4eb7-8acf-0526420aabd4 req-c8f65058-ae84-4501-8356-ad0a6cea1084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-plugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b7b06080-7c3f-4eb7-8acf-0526420aabd4 req-c8f65058-ae84-4501-8356-ad0a6cea1084 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b7b06080-7c3f-4eb7-8acf-0526420aabd4 req-c8f65058-ae84-4501-8356-ad0a6cea1084 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b7b06080-7c3f-4eb7-8acf-0526420aabd4 req-c8f65058-ae84-4501-8356-ad0a6cea1084 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-b7b06080-7c3f-4eb7-8acf-0526420aabd4 req-c8f65058-ae84-4501-8356-ad0a6cea1084 service nova] Creating event network-vif-plugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:42:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-b7b06080-7c3f-4eb7-8acf-0526420aabd4 req-c8f65058-ae84-4501-8356-ad0a6cea1084 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037757 Apr 14 04:42:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 344/1026] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:07 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-5d8cbe5e-d276-45b4-8d34-23cf4cc14c47 req-9709dfde-0106-46e8-91df-20b8f19fc02e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:08 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5d8cbe5e-d276-45b4-8d34-23cf4cc14c47 req-9709dfde-0106-46e8-91df-20b8f19fc02e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5d8cbe5e-d276-45b4-8d34-23cf4cc14c47 req-9709dfde-0106-46e8-91df-20b8f19fc02e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-5d8cbe5e-d276-45b4-8d34-23cf4cc14c47 req-9709dfde-0106-46e8-91df-20b8f19fc02e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-5d8cbe5e-d276-45b4-8d34-23cf4cc14c47 req-9709dfde-0106-46e8-91df-20b8f19fc02e service nova] Creating event network-changed:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:42:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-5d8cbe5e-d276-45b4-8d34-23cf4cc14c47 req-9709dfde-0106-46e8-91df-20b8f19fc02e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035053 Apr 14 04:42:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 340/1027] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:08 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:42:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2869c539-e258-45a2-85fb-cf3943c45967 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27" status: 204 len: 0 microversion: 2.1 time: 0.174728 Apr 14 04:42:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 344/1028] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:42:08 2023] DELETE /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:09 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bcf79de7da27495dbfd14c556b5b54c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '693d95858c624feaa60114aa89082186', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:09 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b6eb5932-ed75-4f80-8894-3ee2774de580 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27" status: 200 len: 1568 microversion: 2.1 time: 0.269275 Apr 14 04:42:09 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 345/1029] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:42:08 2023] GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27 => generated 1568 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:42:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-1dbe70c4-bfc0-4c90-9ba6-745cad69db74 req-30770ff6-58ea-44c4-8720-fd8de5ef47d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "name": "network-vif-deleted", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f0fb6cc1-ed2a-4588-80b4-f134ee28b855 req-be34bf64-fc01-4aba-892a-1c3458d11f5a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "name": "network-vif-unplugged", "status": "completed", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}, {"server_uuid": "49c7ae26-8d9e-45ac-a189-3ee84e015b27", "name": "network-vif-plugged", "status": "completed", "tag": "f204cf26-ba59-48a1-b08e-6d8915075961"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1dbe70c4-bfc0-4c90-9ba6-745cad69db74 req-30770ff6-58ea-44c4-8720-fd8de5ef47d2 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1dbe70c4-bfc0-4c90-9ba6-745cad69db74 req-30770ff6-58ea-44c4-8720-fd8de5ef47d2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-1dbe70c4-bfc0-4c90-9ba6-745cad69db74 req-30770ff6-58ea-44c4-8720-fd8de5ef47d2 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:10 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f0fb6cc1-ed2a-4588-80b4-f134ee28b855 req-be34bf64-fc01-4aba-892a-1c3458d11f5a service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f0fb6cc1-ed2a-4588-80b4-f134ee28b855 req-be34bf64-fc01-4aba-892a-1c3458d11f5a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f0fb6cc1-ed2a-4588-80b4-f134ee28b855 req-be34bf64-fc01-4aba-892a-1c3458d11f5a service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-1dbe70c4-bfc0-4c90-9ba6-745cad69db74 req-30770ff6-58ea-44c4-8720-fd8de5ef47d2 service nova] Creating event network-vif-deleted:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:42:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f0fb6cc1-ed2a-4588-80b4-f134ee28b855 req-be34bf64-fc01-4aba-892a-1c3458d11f5a service nova] Creating event network-vif-unplugged:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:42:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f0fb6cc1-ed2a-4588-80b4-f134ee28b855 req-be34bf64-fc01-4aba-892a-1c3458d11f5a service nova] Creating event network-vif-plugged:f204cf26-ba59-48a1-b08e-6d8915075961 for instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 on user Apr 14 04:42:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f0fb6cc1-ed2a-4588-80b4-f134ee28b855 req-be34bf64-fc01-4aba-892a-1c3458d11f5a service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.034373 Apr 14 04:42:10 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 345/1030] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-1dbe70c4-bfc0-4c90-9ba6-745cad69db74 req-30770ff6-58ea-44c4-8720-fd8de5ef47d2 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054978 Apr 14 04:42:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 341/1031] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=21,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=12 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1029679327", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "networks": [{"uuid": "b3ff401b-8246-4be0-b449-be9d89314f53"}]}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.network.neutron [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] validate_networks() for [('b3ff401b-8246-4be0-b449-be9d89314f53', None, None, None, None, None)] {{(pid=61596) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Flavor limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Image limits 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Flavor pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Image pref 0:0:0 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.virt.hardware [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61596) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Getting quotas for project 3fb95f5c644e4da8b9ab39f07ea79955. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Getting quotas for user e8c753ed91f748b8842b022e65b1cfac and project 3fb95f5c644e4da8b9ab39f07ea79955. Resources: {'ram', 'instances', 'cores'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Going to run 1 instances... {{(pid=61596) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:42:20 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] [instance: d3f489a4-972c-4c96-9235-596c23910a9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61596) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:42:20 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2ea77dae-7aed-4622-b0b2-d3e4aaae9a11 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 378 microversion: 2.1 time: 0.821426 Apr 14 04:42:20 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 346/1032] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:42:20 2023] POST /compute/v2.1/servers => generated 378 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:42:20 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:20 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:20 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-5e20e66c-47ac-44bc-941b-ccdd08f57f3b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:21 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-5e20e66c-47ac-44bc-941b-ccdd08f57f3b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] [instance: d3f489a4-972c-4c96-9235-596c23910a9b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:21 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-5e20e66c-47ac-44bc-941b-ccdd08f57f3b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c753ed91f748b8842b022e65b1cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb95f5c644e4da8b9ab39f07ea79955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-5e20e66c-47ac-44bc-941b-ccdd08f57f3b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b" status: 200 len: 1208 microversion: 2.1 time: 0.084669 Apr 14 04:42:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 346/1033] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:42:20 2023] GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b => generated 1208 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:42:23 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:23 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=12 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:23 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-62a4bee7-51f6-45c0-87c9-d14e150b6fc8 req-ed1c038e-0e33-4c92-830c-15372d851a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d3f489a4-972c-4c96-9235-596c23910a9b", "tag": "e40f091d-175e-40ad-9b0f-56d648135fff"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-62a4bee7-51f6-45c0-87c9-d14e150b6fc8 req-ed1c038e-0e33-4c92-830c-15372d851a5e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-62a4bee7-51f6-45c0-87c9-d14e150b6fc8 req-ed1c038e-0e33-4c92-830c-15372d851a5e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:23 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-62a4bee7-51f6-45c0-87c9-d14e150b6fc8 req-ed1c038e-0e33-4c92-830c-15372d851a5e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-62a4bee7-51f6-45c0-87c9-d14e150b6fc8 req-ed1c038e-0e33-4c92-830c-15372d851a5e service nova] Creating event network-changed:e40f091d-175e-40ad-9b0f-56d648135fff for instance d3f489a4-972c-4c96-9235-596c23910a9b on user Apr 14 04:42:23 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-62a4bee7-51f6-45c0-87c9-d14e150b6fc8 req-ed1c038e-0e33-4c92-830c-15372d851a5e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035445 Apr 14 04:42:23 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 342/1034] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:23 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:25 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-1ebdf6b6-51e3-4927-ad40-977a4b536367 req-930bfe25-7e9b-4839-9bea-9fa2f952a5e6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f489a4-972c-4c96-9235-596c23910a9b", "name": "network-vif-plugged", "status": "completed", "tag": "e40f091d-175e-40ad-9b0f-56d648135fff"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1ebdf6b6-51e3-4927-ad40-977a4b536367 req-930bfe25-7e9b-4839-9bea-9fa2f952a5e6 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1ebdf6b6-51e3-4927-ad40-977a4b536367 req-930bfe25-7e9b-4839-9bea-9fa2f952a5e6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:25 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-1ebdf6b6-51e3-4927-ad40-977a4b536367 req-930bfe25-7e9b-4839-9bea-9fa2f952a5e6 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-1ebdf6b6-51e3-4927-ad40-977a4b536367 req-930bfe25-7e9b-4839-9bea-9fa2f952a5e6 service nova] Creating event network-vif-plugged:e40f091d-175e-40ad-9b0f-56d648135fff for instance d3f489a4-972c-4c96-9235-596c23910a9b on user Apr 14 04:42:25 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-1ebdf6b6-51e3-4927-ad40-977a4b536367 req-930bfe25-7e9b-4839-9bea-9fa2f952a5e6 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027822 Apr 14 04:42:25 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 347/1035] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:25 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:27 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-18b71155-06ff-4236-9116-feee1b1dc369 req-1d315775-ce6c-4e67-9f24-dbec4256f40d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f489a4-972c-4c96-9235-596c23910a9b", "name": "network-vif-plugged", "status": "completed", "tag": "e40f091d-175e-40ad-9b0f-56d648135fff"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:42:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-18b71155-06ff-4236-9116-feee1b1dc369 req-1d315775-ce6c-4e67-9f24-dbec4256f40d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-18b71155-06ff-4236-9116-feee1b1dc369 req-1d315775-ce6c-4e67-9f24-dbec4256f40d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-18b71155-06ff-4236-9116-feee1b1dc369 req-1d315775-ce6c-4e67-9f24-dbec4256f40d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-18b71155-06ff-4236-9116-feee1b1dc369 req-1d315775-ce6c-4e67-9f24-dbec4256f40d service nova] Creating event network-vif-plugged:e40f091d-175e-40ad-9b0f-56d648135fff for instance d3f489a4-972c-4c96-9235-596c23910a9b on user Apr 14 04:42:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-18b71155-06ff-4236-9116-feee1b1dc369 req-1d315775-ce6c-4e67-9f24-dbec4256f40d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038334 Apr 14 04:42:27 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 347/1036] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:42:27 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:50 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:42:50 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-96f90f80-8426-436d-b47f-c00b09dfe821 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 200 len: 1587 microversion: 2.20 time: 0.157176 Apr 14 04:42:50 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 343/1037] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:42:50 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 1587 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=3 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 49c7ae26-8d9e-45ac-a189-3ee84e015b27] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 could not be found. Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:42:59 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27 HTTP/1.1 Apr 14 04:42:59 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:42:59 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:42:59 user devstack@n-api.service[61596]: Connection: close Apr 14 04:42:59 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:42:59 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:42:59 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:42:59 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:42:59 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:42:59 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:59 user devstack@n-api.service[61596]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:42:59 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:42:59 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:42:59 user devstack@n-api.service[61596]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:42:59 user devstack@n-api.service[61596]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:42:59 user devstack@n-api.service[61596]: method: > Apr 14 04:42:59 user devstack@n-api.service[61596]: exception: Instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 could not be found. Apr 14 04:42:59 user devstack@n-api.service[61596]: action_args: {'id': '49c7ae26-8d9e-45ac-a189-3ee84e015b27'} Apr 14 04:42:59 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 could not be found. Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 could not be found. Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 could not be found. Apr 14 04:42:59 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance 49c7ae26-8d9e-45ac-a189-3ee84e015b27 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:42:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-cda0eada-2c5e-450e-be1f-67ad45c7c921 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27" status: 404 len: 111 microversion: 2.1 time: 0.038069 Apr 14 04:42:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 348/1038] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:42:59 2023] GET /compute/v2.1/servers/49c7ae26-8d9e-45ac-a189-3ee84e015b27 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:42:59 user devstack@n-api.service[61597]: request: DELETE /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae HTTP/1.1 Apr 14 04:42:59 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:42:59 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:42:59 user devstack@n-api.service[61597]: Connection: close Apr 14 04:42:59 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:42:59 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:42:59 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:42:59 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:42:59 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:42:59 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:42:59 user devstack@n-api.service[61597]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:42:59 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:42:59 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:42:59 user devstack@n-api.service[61597]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:42:59 user devstack@n-api.service[61597]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:42:59 user devstack@n-api.service[61597]: method: > Apr 14 04:42:59 user devstack@n-api.service[61597]: exception: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:42:59 user devstack@n-api.service[61597]: action_args: {'id': '4b704133-1b1a-4579-857a-c74cd8b24fae'} Apr 14 04:42:59 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:42:59 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:42:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:42:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-863e9e6a-9023-4d0e-9ef6-6658f6e3e25f tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 404 len: 111 microversion: 2.1 time: 0.038227 Apr 14 04:42:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 348/1039] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:42:59 2023] DELETE /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] [instance: 4b704133-1b1a-4579-857a-c74cd8b24fae] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:42:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] HTTP exception thrown: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:43:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Request method failure captured: Apr 14 04:43:00 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae HTTP/1.1 Apr 14 04:43:00 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:43:00 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:43:00 user devstack@n-api.service[61595]: Connection: close Apr 14 04:43:00 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:43:00 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:43:00 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:43:00 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:43:00 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONXGil2xdZ1RApXWZ3Xe5ksPrEd9i2kQsK4oOMLbgYKnZY3k114HyWuSIEhbY47I24Zp1nTVrh5i3-ZLClKCxHTOZph2SK4xfi2usux56cp5dTaGWzLb5sKwjPqi4rKtFYzTf3LvtvFOvhsBKdLqp0QlfAIEa6miRdwVRxzNmVsOgGg Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Project-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Project-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/693d95858c624feaa60114aa89082186"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/693d95858c624feaa60114aa89082186"}]}] Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Tenant: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Tenant-Id: 693d95858c624feaa60114aa89082186 Apr 14 04:43:00 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-TestVolumeBootPattern-1780160917 Apr 14 04:43:00 user devstack@n-api.service[61595]: X-User: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:43:00 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:43:00 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:43:00 user devstack@n-api.service[61595]: X-User-Id: bcf79de7da27495dbfd14c556b5b54c7 Apr 14 04:43:00 user devstack@n-api.service[61595]: X-User-Name: tempest-TestVolumeBootPattern-1780160917-project-member Apr 14 04:43:00 user devstack@n-api.service[61595]: method: > Apr 14 04:43:00 user devstack@n-api.service[61595]: exception: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:43:00 user devstack@n-api.service[61595]: action_args: {'id': '4b704133-1b1a-4579-857a-c74cd8b24fae'} Apr 14 04:43:00 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. Apr 14 04:43:00 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:43:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Returning 404 to user: Instance 4b704133-1b1a-4579-857a-c74cd8b24fae could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:43:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b24e3be8-f14f-4f61-a0df-e042f3e2b428 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae" status: 404 len: 111 microversion: 2.1 time: 0.303262 Apr 14 04:43:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 344/1040] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:42:59 2023] GET /compute/v2.1/servers/4b704133-1b1a-4579-857a-c74cd8b24fae => generated 111 bytes in 306 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:43:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e01c9b06-b555-4dbc-b982-376fd00d9d08 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] Calling method '.version_select at 0x7f538ae15750>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e01c9b06-b555-4dbc-b982-376fd00d9d08 tempest-TestVolumeBootPattern-1780160917 tempest-TestVolumeBootPattern-1780160917-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1640497739" status: 202 len: 0 microversion: 2.1 time: 0.022633 Apr 14 04:43:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 349/1041] 10.0.0.210 () {62 vars in 1340 bytes} [Fri Apr 14 04:43:03 2023] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1640497739 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-28eff689-61a8-4452-b5a0-906f8e3f01bb tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.139146 Apr 14 04:43:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 349/1042] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:43:06 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-interface => generated 282 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:43:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-b202f8dd-c123-44b8-9d1a-425043d28a91 req-47e10e43-0796-47d6-8ef8-413a737d0fee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d8009dc-c463-41f2-8b36-21862b7ad5ca", "tag": "6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:43:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b202f8dd-c123-44b8-9d1a-425043d28a91 req-47e10e43-0796-47d6-8ef8-413a737d0fee service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b202f8dd-c123-44b8-9d1a-425043d28a91 req-47e10e43-0796-47d6-8ef8-413a737d0fee service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:07 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-b202f8dd-c123-44b8-9d1a-425043d28a91 req-47e10e43-0796-47d6-8ef8-413a737d0fee service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-b202f8dd-c123-44b8-9d1a-425043d28a91 req-47e10e43-0796-47d6-8ef8-413a737d0fee service nova] Creating event network-changed:6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68 for instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca on user Apr 14 04:43:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-b202f8dd-c123-44b8-9d1a-425043d28a91 req-47e10e43-0796-47d6-8ef8-413a737d0fee service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033382 Apr 14 04:43:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 345/1043] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:43:07 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-caf9799b-bc6a-47f1-91db-c4ddf8ddf99c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/ips" status: 200 len: 107 microversion: 2.1 time: 0.039215 Apr 14 04:43:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 350/1044] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:43:07 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/ips => generated 107 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:10 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:10 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4c817f47-2d17-4cfa-beb0-9f6173f158cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.291270 Apr 14 04:43:10 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 350/1045] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:43:10 2023] POST /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments => generated 194 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] [instance: d3f489a4-972c-4c96-9235-596c23910a9b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:11 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c753ed91f748b8842b022e65b1cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb95f5c644e4da8b9ab39f07ea79955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:43:11 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-52d45163-1374-4676-9dbc-31f85853c38b tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b" status: 200 len: 1484 microversion: 2.1 time: 0.154930 Apr 14 04:43:11 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 346/1046] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:43:11 2023] GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b => generated 1484 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7"}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Invalid volume: volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 is already attached to instances: 3d8009dc-c463-41f2-8b36-21862b7ad5ca Apr 14 04:43:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:43:18 user devstack@n-api.service[61596]: request: POST /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments HTTP/1.1 Apr 14 04:43:18 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:43:18 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:43:18 user devstack@n-api.service[61596]: Connection: close Apr 14 04:43:18 user devstack@n-api.service[61596]: Content-Length: 74 Apr 14 04:43:18 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:43:18 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:43:18 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:43:18 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:43:18 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:43:18 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:43:18 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:43:18 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:43:18 user devstack@n-api.service[61596]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:43:18 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:43:18 user devstack@n-api.service[61596]: Apr 14 04:43:18 user devstack@n-api.service[61596]: {"volumeAttachment": {"volumeId": "5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7"}} Apr 14 04:43:18 user devstack@n-api.service[61596]: method: > Apr 14 04:43:18 user devstack@n-api.service[61596]: exception: Invalid volume: volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 is already attached to instances: 3d8009dc-c463-41f2-8b36-21862b7ad5ca Apr 14 04:43:18 user devstack@n-api.service[61596]: action_args: {'server_id': '3d8009dc-c463-41f2-8b36-21862b7ad5ca', 'body': {'volumeAttachment': {'volumeId': '5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7'}}} Apr 14 04:43:18 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5139, in attach_volume Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4979, in _check_volume_already_attached Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 is already attached to instances: 3d8009dc-c463-41f2-8b36-21862b7ad5ca Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 is already attached to instances: 3d8009dc-c463-41f2-8b36-21862b7ad5ca Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 is already attached to instances: 3d8009dc-c463-41f2-8b36-21862b7ad5ca Apr 14 04:43:18 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:43:18 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 400 to user: Invalid volume: volume 5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 is already attached to instances: 3d8009dc-c463-41f2-8b36-21862b7ad5ca {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:43:18 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-78e06832-4bf3-4ac3-a929-825056af47e5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101116 Apr 14 04:43:18 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 351/1047] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:43:17 2023] POST /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments => generated 174 bytes in 102 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:18 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lazy-loading 'services' on Instance uuid 3d8009dc-c463-41f2-8b36-21862b7ad5ca {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:43:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3f7d9c3c-b0c9-4932-8a90-cba7766d76cf tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments/5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7" status: 202 len: 0 microversion: 2.1 time: 0.178414 Apr 14 04:43:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 351/1048] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:43:18 2023] DELETE /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments/5b1bb6a7-c9a7-4ac1-9a24-c912f5f812e7 => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:18 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1455cd66-ba1a-4da5-ac92-b76c46427159 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048403 Apr 14 04:43:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 347/1049] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:43:18 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:51 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-bca20272-b2df-47bb-843b-b738b3010025 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-interface" status: 200 len: 282 microversion: 2.20 time: 0.321774 Apr 14 04:43:51 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 352/1050] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 04:43:50 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-interface => generated 282 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:43:51 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:51 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:51 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:51 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:51 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=10 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:52 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=22 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:43:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-db740312-8c59-4b47-9943-f4a379828d5f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/ips" status: 200 len: 110 microversion: 2.20 time: 0.042474 Apr 14 04:43:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 348/1051] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 04:43:51 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/ips => generated 110 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:43:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-1b90a958-7688-428e-8a65-15de6512bb2d req-9f1ba33d-3a0d-4479-a380-d641c8393b41 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:43:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1b90a958-7688-428e-8a65-15de6512bb2d req-9f1ba33d-3a0d-4479-a380-d641c8393b41 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1b90a958-7688-428e-8a65-15de6512bb2d req-9f1ba33d-3a0d-4479-a380-d641c8393b41 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-1b90a958-7688-428e-8a65-15de6512bb2d req-9f1ba33d-3a0d-4479-a380-d641c8393b41 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-1b90a958-7688-428e-8a65-15de6512bb2d req-9f1ba33d-3a0d-4479-a380-d641c8393b41 service nova] Creating event network-changed:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:43:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-1b90a958-7688-428e-8a65-15de6512bb2d req-9f1ba33d-3a0d-4479-a380-d641c8393b41 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.153055 Apr 14 04:43:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 352/1052] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:43:51 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:54 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lazy-loading 'flavor' on Instance uuid 77f6bb83-54ab-485e-8943-742f2f576607 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:43:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c7b7d9d1-68a5-4de5-8a13-3fd2cc2c6d39 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/action" status: 202 len: 0 microversion: 2.20 time: 0.825978 Apr 14 04:43:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 353/1053] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:43:54 2023] POST /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/action => generated 0 bytes in 827 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:43:55 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:43:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-16b85c1e-f1ea-4c08-8aad-6a98c008cdb0 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 200 len: 1712 microversion: 2.20 time: 0.341171 Apr 14 04:43:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 349/1054] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:43:55 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 1712 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:43:55 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-860b7394-6da7-43f9-bd07-8bdf3ebaaa66 req-eb35a7f2-0770-4854-a463-4b648d522206 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-unplugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:43:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-860b7394-6da7-43f9-bd07-8bdf3ebaaa66 req-eb35a7f2-0770-4854-a463-4b648d522206 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-860b7394-6da7-43f9-bd07-8bdf3ebaaa66 req-eb35a7f2-0770-4854-a463-4b648d522206 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:55 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-860b7394-6da7-43f9-bd07-8bdf3ebaaa66 req-eb35a7f2-0770-4854-a463-4b648d522206 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:55 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-860b7394-6da7-43f9-bd07-8bdf3ebaaa66 req-eb35a7f2-0770-4854-a463-4b648d522206 service nova] Creating event network-vif-unplugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:43:55 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-860b7394-6da7-43f9-bd07-8bdf3ebaaa66 req-eb35a7f2-0770-4854-a463-4b648d522206 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031583 Apr 14 04:43:55 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 353/1055] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:43:55 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:43:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-3eb53b0c-b73b-483d-83bf-780381d0774a req-c0b3641a-b879-41c8-8c2b-27edf1b6e410 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-plugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:43:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3eb53b0c-b73b-483d-83bf-780381d0774a req-c0b3641a-b879-41c8-8c2b-27edf1b6e410 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:43:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3eb53b0c-b73b-483d-83bf-780381d0774a req-c0b3641a-b879-41c8-8c2b-27edf1b6e410 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:43:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-3eb53b0c-b73b-483d-83bf-780381d0774a req-c0b3641a-b879-41c8-8c2b-27edf1b6e410 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:43:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-3eb53b0c-b73b-483d-83bf-780381d0774a req-c0b3641a-b879-41c8-8c2b-27edf1b6e410 service nova] Creating event network-vif-plugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:43:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-3eb53b0c-b73b-483d-83bf-780381d0774a req-c0b3641a-b879-41c8-8c2b-27edf1b6e410 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028369 Apr 14 04:43:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 354/1056] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:43:57 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:44:00 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-e840d1fd-3eb5-475b-9f4f-d9062a548a66 req-7a3e04d4-f7e3-42ca-b235-4ffb54546820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e840d1fd-3eb5-475b-9f4f-d9062a548a66 req-7a3e04d4-f7e3-42ca-b235-4ffb54546820 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e840d1fd-3eb5-475b-9f4f-d9062a548a66 req-7a3e04d4-f7e3-42ca-b235-4ffb54546820 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:00 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-e840d1fd-3eb5-475b-9f4f-d9062a548a66 req-7a3e04d4-f7e3-42ca-b235-4ffb54546820 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-e840d1fd-3eb5-475b-9f4f-d9062a548a66 req-7a3e04d4-f7e3-42ca-b235-4ffb54546820 service nova] Creating event network-changed:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:44:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-e840d1fd-3eb5-475b-9f4f-d9062a548a66 req-7a3e04d4-f7e3-42ca-b235-4ffb54546820 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106347 Apr 14 04:44:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 350/1057] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:44:00 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-954fd7e1-5857-4254-afd6-739f82df7685 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053359 Apr 14 04:44:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 354/1058] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:44:08 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:44:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-09c6abaa-2621-4b36-8266-1aca7a222a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca" status: 204 len: 0 microversion: 2.1 time: 0.121299 Apr 14 04:44:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 355/1059] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:44:08 2023] DELETE /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:08 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:44:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-c7798e0d-7bef-4aa8-b614-a11e185dc291 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca" status: 200 len: 1669 microversion: 2.1 time: 0.235910 Apr 14 04:44:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 351/1060] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:44:08 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca => generated 1669 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-16c6b243-806a-40cd-825f-7270b9be6658 req-e39f5d14-f087-462c-b981-a22ffb27946e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8009dc-c463-41f2-8b36-21862b7ad5ca", "name": "network-vif-unplugged", "status": "completed", "tag": "6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-16c6b243-806a-40cd-825f-7270b9be6658 req-e39f5d14-f087-462c-b981-a22ffb27946e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-16c6b243-806a-40cd-825f-7270b9be6658 req-e39f5d14-f087-462c-b981-a22ffb27946e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-16c6b243-806a-40cd-825f-7270b9be6658 req-e39f5d14-f087-462c-b981-a22ffb27946e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-16c6b243-806a-40cd-825f-7270b9be6658 req-e39f5d14-f087-462c-b981-a22ffb27946e service nova] Creating event network-vif-unplugged:6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68 for instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca on user Apr 14 04:44:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-16c6b243-806a-40cd-825f-7270b9be6658 req-e39f5d14-f087-462c-b981-a22ffb27946e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029081 Apr 14 04:44:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 355/1061] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:44:08 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:44:10 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-95011e8a-9093-4c90-9672-247fbb9e340a req-e77f16ce-0805-4c4c-8957-cc9085abc149 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8009dc-c463-41f2-8b36-21862b7ad5ca", "name": "network-vif-deleted", "tag": "6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-95011e8a-9093-4c90-9672-247fbb9e340a req-e77f16ce-0805-4c4c-8957-cc9085abc149 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-95011e8a-9093-4c90-9672-247fbb9e340a req-e77f16ce-0805-4c4c-8957-cc9085abc149 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:10 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-95011e8a-9093-4c90-9672-247fbb9e340a req-e77f16ce-0805-4c4c-8957-cc9085abc149 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-95011e8a-9093-4c90-9672-247fbb9e340a req-e77f16ce-0805-4c4c-8957-cc9085abc149 service nova] Creating event network-vif-deleted:6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68 for instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca on user Apr 14 04:44:10 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-95011e8a-9093-4c90-9672-247fbb9e340a req-e77f16ce-0805-4c4c-8957-cc9085abc149 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034289 Apr 14 04:44:10 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 356/1062] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:44:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-cf4135aa-1ae3-44af-a1a4-e93ca0d97554 req-6f27a626-ee33-4247-88a1-d62759427495 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d8009dc-c463-41f2-8b36-21862b7ad5ca", "name": "network-vif-plugged", "status": "completed", "tag": "6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cf4135aa-1ae3-44af-a1a4-e93ca0d97554 req-6f27a626-ee33-4247-88a1-d62759427495 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cf4135aa-1ae3-44af-a1a4-e93ca0d97554 req-6f27a626-ee33-4247-88a1-d62759427495 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cf4135aa-1ae3-44af-a1a4-e93ca0d97554 req-6f27a626-ee33-4247-88a1-d62759427495 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-cf4135aa-1ae3-44af-a1a4-e93ca0d97554 req-6f27a626-ee33-4247-88a1-d62759427495 service nova] Creating event network-vif-plugged:6d9b1d34-ea57-4e92-bdc3-1bd292ce5e68 for instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca on user Apr 14 04:44:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-cf4135aa-1ae3-44af-a1a4-e93ca0d97554 req-6f27a626-ee33-4247-88a1-d62759427495 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046546 Apr 14 04:44:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 352/1063] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:44:10 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] [instance: d3f489a4-972c-4c96-9235-596c23910a9b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:17 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] [instance: d3f489a4-972c-4c96-9235-596c23910a9b] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:44:17 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-906527f4-0fe2-458c-a8eb-c7f499112fa2 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b" status: 204 len: 0 microversion: 2.1 time: 0.114790 Apr 14 04:44:17 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 356/1064] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:44:17 2023] DELETE /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] [instance: d3f489a4-972c-4c96-9235-596c23910a9b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:17 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8c753ed91f748b8842b022e65b1cfac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fb95f5c644e4da8b9ab39f07ea79955', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:44:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1333856a-4c57-498d-a50b-25b7157ede8c tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b" status: 200 len: 1490 microversion: 2.1 time: 0.242110 Apr 14 04:44:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 357/1065] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:44:17 2023] GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b => generated 1490 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:44:17 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-db65b880-2e79-4858-833a-cad688facf70 req-7cb3fa03-df64-4f4c-8fe2-fecae7d012a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f489a4-972c-4c96-9235-596c23910a9b", "name": "network-vif-unplugged", "status": "completed", "tag": "e40f091d-175e-40ad-9b0f-56d648135fff"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-db65b880-2e79-4858-833a-cad688facf70 req-7cb3fa03-df64-4f4c-8fe2-fecae7d012a0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-db65b880-2e79-4858-833a-cad688facf70 req-7cb3fa03-df64-4f4c-8fe2-fecae7d012a0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:17 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-db65b880-2e79-4858-833a-cad688facf70 req-7cb3fa03-df64-4f4c-8fe2-fecae7d012a0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-db65b880-2e79-4858-833a-cad688facf70 req-7cb3fa03-df64-4f4c-8fe2-fecae7d012a0 service nova] Creating event network-vif-unplugged:e40f091d-175e-40ad-9b0f-56d648135fff for instance d3f489a4-972c-4c96-9235-596c23910a9b on user Apr 14 04:44:17 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-db65b880-2e79-4858-833a-cad688facf70 req-7cb3fa03-df64-4f4c-8fe2-fecae7d012a0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032188 Apr 14 04:44:17 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 353/1066] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:44:17 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:44:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-2fd1b711-3aa4-4253-8fb6-dd72795988bd req-8313ffd4-3c65-4fc0-8d55-b5007e19091c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f489a4-972c-4c96-9235-596c23910a9b", "name": "network-vif-deleted", "tag": "e40f091d-175e-40ad-9b0f-56d648135fff"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2fd1b711-3aa4-4253-8fb6-dd72795988bd req-8313ffd4-3c65-4fc0-8d55-b5007e19091c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2fd1b711-3aa4-4253-8fb6-dd72795988bd req-8313ffd4-3c65-4fc0-8d55-b5007e19091c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-2fd1b711-3aa4-4253-8fb6-dd72795988bd req-8313ffd4-3c65-4fc0-8d55-b5007e19091c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-2fd1b711-3aa4-4253-8fb6-dd72795988bd req-8313ffd4-3c65-4fc0-8d55-b5007e19091c service nova] Creating event network-vif-deleted:e40f091d-175e-40ad-9b0f-56d648135fff for instance d3f489a4-972c-4c96-9235-596c23910a9b on user Apr 14 04:44:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-2fd1b711-3aa4-4253-8fb6-dd72795988bd req-8313ffd4-3c65-4fc0-8d55-b5007e19091c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028676 Apr 14 04:44:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 357/1067] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:44:18 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:44:19 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-2d8adfb1-8267-40f3-85e1-4ab1d824f646 req-89c2bab7-15e8-4330-a5ec-6aeb6e0b1a77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d3f489a4-972c-4c96-9235-596c23910a9b", "name": "network-vif-plugged", "status": "completed", "tag": "e40f091d-175e-40ad-9b0f-56d648135fff"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2d8adfb1-8267-40f3-85e1-4ab1d824f646 req-89c2bab7-15e8-4330-a5ec-6aeb6e0b1a77 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2d8adfb1-8267-40f3-85e1-4ab1d824f646 req-89c2bab7-15e8-4330-a5ec-6aeb6e0b1a77 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:19 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-2d8adfb1-8267-40f3-85e1-4ab1d824f646 req-89c2bab7-15e8-4330-a5ec-6aeb6e0b1a77 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-2d8adfb1-8267-40f3-85e1-4ab1d824f646 req-89c2bab7-15e8-4330-a5ec-6aeb6e0b1a77 service nova] Creating event network-vif-plugged:e40f091d-175e-40ad-9b0f-56d648135fff for instance d3f489a4-972c-4c96-9235-596c23910a9b on user Apr 14 04:44:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-2d8adfb1-8267-40f3-85e1-4ab1d824f646 req-89c2bab7-15e8-4330-a5ec-6aeb6e0b1a77 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032619 Apr 14 04:44:19 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 358/1068] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:44:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=12 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=22 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:45 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:46 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:44:46 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:44:46 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:44:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-f98c46bd-001b-4acc-a0fb-ec29ed396bbd tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 200 len: 1653 microversion: 2.20 time: 0.176779 Apr 14 04:44:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 354/1069] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:44:45 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 1653 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:44:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:44:58 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca HTTP/1.1 Apr 14 04:44:58 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:44:58 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:44:58 user devstack@n-api.service[61597]: Connection: close Apr 14 04:44:58 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:44:58 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:44:58 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:44:58 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:44:58 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:44:58 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:44:58 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:44:58 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:44:58 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:44:58 user devstack@n-api.service[61597]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:44:58 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:44:58 user devstack@n-api.service[61597]: method: > Apr 14 04:44:58 user devstack@n-api.service[61597]: exception: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:44:58 user devstack@n-api.service[61597]: action_args: {'id': '3d8009dc-c463-41f2-8b36-21862b7ad5ca'} Apr 14 04:44:58 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:44:58 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:44:58 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:44:58 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-65112207-adb7-47f8-ac60-e51791b72967 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca" status: 404 len: 111 microversion: 2.1 time: 0.043508 Apr 14 04:44:58 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 358/1070] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:44:58 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:44:58 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=13,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:58 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-e7fadf7f-0602-41b8-b018-d1c51f5c8cb0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '.version_select at 0x7f538ac6e950>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:44:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-e7fadf7f-0602-41b8-b018-d1c51f5c8cb0 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017831093" status: 202 len: 0 microversion: 2.1 time: 0.028400 Apr 14 04:44:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 359/1071] 10.0.0.210 () {62 vars in 1298 bytes} [Fri Apr 14 04:44:58 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2017831093 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:44:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-577d77c2-5a4f-4088-918a-307b5d6e26c5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: .version_select at 0x7f538ac6de10>, body: {"keypair": {"name": "tempest-keypair-276811093", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPq10jRsZwJAwjn8fWjAt5oHsMf2IPnRo2qmPAUD/9zrrvsoEgKc9ia04kVf6fotTh4Pv5yyx4MxgJSrLSbRN1rSGK9xMKoeETId4pSL+n09LaBGKTmlM0sgh6MwFAvp1A=="}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:44:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:44:59 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-577d77c2-5a4f-4088-918a-307b5d6e26c5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:44:59 user devstack@n-api.service[61595]: DEBUG nova.quota [None req-577d77c2-5a4f-4088-918a-307b5d6e26c5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'key_pairs'} {{(pid=61595) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:44:59 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-577d77c2-5a4f-4088-918a-307b5d6e26c5 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.063650 Apr 14 04:44:59 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 355/1072] 10.0.0.210 () {64 vars in 1236 bytes} [Fri Apr 14 04:44:59 2023] POST /compute/v2.1/os-keypairs => generated 385 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:45:01 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-441026141", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "f58d1c12-4d40-40b9-93c5-2db82486289a"}], "security_groups": [{"name": "tempest-securitygroup--861870031"}], "key_name": "tempest-keypair-276811093", "user_data": "}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:45:01 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] validate_networks() for [('f58d1c12-4d40-40b9-93c5-2db82486289a', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Getting quotas for user 7cab2461ab0d4eb08b62feaf6396bc87 and project 601e2806907a48d3995cc90b54da3c8c. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:45:02 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:45:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-57ce5ea8-3bb0-4b17-9243-37af467a1b49 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 0.631498 Apr 14 04:45:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 359/1073] 10.0.0.210 () {64 vars in 1224 bytes} [Fri Apr 14 04:45:01 2023] POST /compute/v2.1/servers => generated 399 bytes in 634 msecs (HTTP/1.1 202) 10 headers in 450 bytes (1 switches on core 0) Apr 14 04:45:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1c80d02e-dbed-4514-ac24-5a955a1ab458 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:45:02 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1c80d02e-dbed-4514-ac24-5a955a1ab458 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:45:02 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1c80d02e-dbed-4514-ac24-5a955a1ab458 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:45:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1c80d02e-dbed-4514-ac24-5a955a1ab458 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b" status: 200 len: 1234 microversion: 2.1 time: 0.061871 Apr 14 04:45:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 360/1074] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:45:02 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b => generated 1234 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:45:04 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-eb224207-5b66-43ba-8824-f4198c246d6d req-7e5325e3-3188-4dbc-a02e-d1f5765c12f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a130f4-02c3-41fc-bbdb-d2b844e1320b", "tag": "7f00e811-6655-498b-a09b-5a45aba618b4"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:45:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-eb224207-5b66-43ba-8824-f4198c246d6d req-7e5325e3-3188-4dbc-a02e-d1f5765c12f0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-eb224207-5b66-43ba-8824-f4198c246d6d req-7e5325e3-3188-4dbc-a02e-d1f5765c12f0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:04 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-eb224207-5b66-43ba-8824-f4198c246d6d req-7e5325e3-3188-4dbc-a02e-d1f5765c12f0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-eb224207-5b66-43ba-8824-f4198c246d6d req-7e5325e3-3188-4dbc-a02e-d1f5765c12f0 service nova] Creating event network-changed:7f00e811-6655-498b-a09b-5a45aba618b4 for instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b on user Apr 14 04:45:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-eb224207-5b66-43ba-8824-f4198c246d6d req-7e5325e3-3188-4dbc-a02e-d1f5765c12f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035355 Apr 14 04:45:04 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 356/1075] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:45:04 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:45:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a4bfcbf9-fa37-489c-9025-1af667e87daf req-0e53e57e-8d26-42f2-82de-906abe2a83f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a130f4-02c3-41fc-bbdb-d2b844e1320b", "name": "network-vif-plugged", "status": "completed", "tag": "7f00e811-6655-498b-a09b-5a45aba618b4"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:45:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a4bfcbf9-fa37-489c-9025-1af667e87daf req-0e53e57e-8d26-42f2-82de-906abe2a83f0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a4bfcbf9-fa37-489c-9025-1af667e87daf req-0e53e57e-8d26-42f2-82de-906abe2a83f0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:06 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a4bfcbf9-fa37-489c-9025-1af667e87daf req-0e53e57e-8d26-42f2-82de-906abe2a83f0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a4bfcbf9-fa37-489c-9025-1af667e87daf req-0e53e57e-8d26-42f2-82de-906abe2a83f0 service nova] Creating event network-vif-plugged:7f00e811-6655-498b-a09b-5a45aba618b4 for instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b on user Apr 14 04:45:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a4bfcbf9-fa37-489c-9025-1af667e87daf req-0e53e57e-8d26-42f2-82de-906abe2a83f0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037274 Apr 14 04:45:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 360/1076] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:45:06 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] [instance: d3f489a4-972c-4c96-9235-596c23910a9b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] HTTP exception thrown: Instance d3f489a4-972c-4c96-9235-596c23910a9b could not be found. Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Request method failure captured: Apr 14 04:45:07 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b HTTP/1.1 Apr 14 04:45:07 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:45:07 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:45:07 user devstack@n-api.service[61596]: Connection: close Apr 14 04:45:07 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:45:07 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:45:07 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:45:07 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:45:07 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONmqxOifRBmuPSCljT-_KqVvmvuIQrcnPsl4gSNdZ2rkos68pkh9RkyNBbrP89_2BBWR5HYQ0oJAqd8r7Z_xeEUnRmqVOPxyBcWBUsXoFK4OUaEYb3IG-1U_J269OE5KyT897tMTS1IMyOIZp5TzZI4b9cNcYv3KdXyumffAc84HMKI Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Project-Id: 3fb95f5c644e4da8b9ab39f07ea79955 Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesActionsTest-318780639 Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/3fb95f5c644e4da8b9ab39f07ea79955"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fb95f5c644e4da8b9ab39f07ea79955"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/3fb95f5c644e4da8b9ab39f07ea79955"}]}] Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesActionsTest-318780639 Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Tenant-Id: 3fb95f5c644e4da8b9ab39f07ea79955 Apr 14 04:45:07 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesActionsTest-318780639 Apr 14 04:45:07 user devstack@n-api.service[61596]: X-User: tempest-VolumesActionsTest-318780639-project-member Apr 14 04:45:07 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:45:07 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:45:07 user devstack@n-api.service[61596]: X-User-Id: e8c753ed91f748b8842b022e65b1cfac Apr 14 04:45:07 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesActionsTest-318780639-project-member Apr 14 04:45:07 user devstack@n-api.service[61596]: method: > Apr 14 04:45:07 user devstack@n-api.service[61596]: exception: Instance d3f489a4-972c-4c96-9235-596c23910a9b could not be found. Apr 14 04:45:07 user devstack@n-api.service[61596]: action_args: {'id': 'd3f489a4-972c-4c96-9235-596c23910a9b'} Apr 14 04:45:07 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d3f489a4-972c-4c96-9235-596c23910a9b could not be found. Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d3f489a4-972c-4c96-9235-596c23910a9b could not be found. Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d3f489a4-972c-4c96-9235-596c23910a9b could not be found. Apr 14 04:45:07 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:45:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] Returning 404 to user: Instance d3f489a4-972c-4c96-9235-596c23910a9b could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:45:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d51faaf3-546f-45d0-9548-6260d24535e8 tempest-VolumesActionsTest-318780639 tempest-VolumesActionsTest-318780639-project-member] 10.0.0.210 "GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b" status: 404 len: 111 microversion: 2.1 time: 0.027948 Apr 14 04:45:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 361/1077] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:45:07 2023] GET /compute/v2.1/servers/d3f489a4-972c-4c96-9235-596c23910a9b => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:45:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-c44f9cfe-11b6-465f-a824-4b488df6d2ac req-1c458cab-39fe-4994-83b5-28c740eb2d54 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a130f4-02c3-41fc-bbdb-d2b844e1320b", "name": "network-vif-plugged", "status": "completed", "tag": "7f00e811-6655-498b-a09b-5a45aba618b4"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:45:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c44f9cfe-11b6-465f-a824-4b488df6d2ac req-1c458cab-39fe-4994-83b5-28c740eb2d54 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c44f9cfe-11b6-465f-a824-4b488df6d2ac req-1c458cab-39fe-4994-83b5-28c740eb2d54 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-c44f9cfe-11b6-465f-a824-4b488df6d2ac req-1c458cab-39fe-4994-83b5-28c740eb2d54 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-c44f9cfe-11b6-465f-a824-4b488df6d2ac req-1c458cab-39fe-4994-83b5-28c740eb2d54 service nova] Creating event network-vif-plugged:7f00e811-6655-498b-a09b-5a45aba618b4 for instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b on user Apr 14 04:45:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-c44f9cfe-11b6-465f-a824-4b488df6d2ac req-1c458cab-39fe-4994-83b5-28c740eb2d54 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045172 Apr 14 04:45:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 357/1078] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:45:08 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8e6a311-8ecf-435d-a4bd-23726576f9bb"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d42f77fc-a0a6-4176-a163-eb34ff2e773f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.308996 Apr 14 04:45:46 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 361/1079] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 04:45:46 2023] POST /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments => generated 188 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:46 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61596) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 04:45:46 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2df75a5e-ccce-41fe-9383-261dbdc41c00 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/action" status: 202 len: 0 microversion: 2.20 time: 0.157735 Apr 14 04:45:46 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 362/1080] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:45:46 2023] POST /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/action => generated 0 bytes in 160 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=15,nova_api:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:45:46 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:45:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-bf0d25bb-8dd6-42b9-a063-86cc487e6ed4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 200 len: 1739 microversion: 2.20 time: 0.200947 Apr 14 04:45:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 358/1081] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:45:46 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 1739 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:52 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:45:52 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-4a1fd3ea-5abd-4bd9-846b-ea2333d00e56 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b" status: 200 len: 1542 microversion: 2.1 time: 0.283004 Apr 14 04:45:52 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 362/1082] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:45:52 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b => generated 1542 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:45:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-509320e5-d045-437e-bba0-790cab5eb534 req-623c5845-8e00-4530-872d-d038a0019acb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:45:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-509320e5-d045-437e-bba0-790cab5eb534 req-623c5845-8e00-4530-872d-d038a0019acb service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:45:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-509320e5-d045-437e-bba0-790cab5eb534 req-623c5845-8e00-4530-872d-d038a0019acb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:45:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-509320e5-d045-437e-bba0-790cab5eb534 req-623c5845-8e00-4530-872d-d038a0019acb service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:45:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-509320e5-d045-437e-bba0-790cab5eb534 req-623c5845-8e00-4530-872d-d038a0019acb service nova] Creating event network-changed:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:45:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-509320e5-d045-437e-bba0-790cab5eb534 req-623c5845-8e00-4530-872d-d038a0019acb service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031819 Apr 14 04:45:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 363/1083] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:45:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:46:01 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-0ccd3e0d-678a-4488-a26a-6b8a150b26e2 req-d779eb42-43dc-48bf-b667-e64a46d76ccf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-plugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:46:01 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:01 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ccd3e0d-678a-4488-a26a-6b8a150b26e2 req-d779eb42-43dc-48bf-b667-e64a46d76ccf service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ccd3e0d-678a-4488-a26a-6b8a150b26e2 req-d779eb42-43dc-48bf-b667-e64a46d76ccf service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:01 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-0ccd3e0d-678a-4488-a26a-6b8a150b26e2 req-d779eb42-43dc-48bf-b667-e64a46d76ccf service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-0ccd3e0d-678a-4488-a26a-6b8a150b26e2 req-d779eb42-43dc-48bf-b667-e64a46d76ccf service nova] Creating event network-vif-plugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:46:01 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-0ccd3e0d-678a-4488-a26a-6b8a150b26e2 req-d779eb42-43dc-48bf-b667-e64a46d76ccf service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048814 Apr 14 04:46:01 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 359/1084] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:46:01 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:46:03 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-400036bd-d3a6-4522-b373-f5df4cae0130 req-5f33be16-d4bb-4f54-a0e1-8970a62fd068 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-plugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:46:03 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:03 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-400036bd-d3a6-4522-b373-f5df4cae0130 req-5f33be16-d4bb-4f54-a0e1-8970a62fd068 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-400036bd-d3a6-4522-b373-f5df4cae0130 req-5f33be16-d4bb-4f54-a0e1-8970a62fd068 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:03 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-400036bd-d3a6-4522-b373-f5df4cae0130 req-5f33be16-d4bb-4f54-a0e1-8970a62fd068 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:03 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-400036bd-d3a6-4522-b373-f5df4cae0130 req-5f33be16-d4bb-4f54-a0e1-8970a62fd068 service nova] Creating event network-vif-plugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:46:03 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-400036bd-d3a6-4522-b373-f5df4cae0130 req-5f33be16-d4bb-4f54-a0e1-8970a62fd068 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068967 Apr 14 04:46:03 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 363/1085] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:46:03 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:46:36 user devstack@n-api.service[61596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c9fe375e-0662-4753-bd9b-6f692b9fe078] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:36 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:37 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:46:37 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:46:37 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:46:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-b655f5de-285f-4439-8ec8-788783e595af tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 200 len: 1784 microversion: 2.20 time: 0.164913 Apr 14 04:46:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 364/1086] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:46:36 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 1784 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:52 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:52 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-16ba19b5-1f56-44c5-b6e2-bbeda0d2eb4e tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-interface" status: 200 len: 282 microversion: 2.1 time: 0.115094 Apr 14 04:46:52 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 360/1087] 10.0.0.210 () {62 vars in 1352 bytes} [Fri Apr 14 04:46:52 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-interface => generated 282 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:46:53 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:53 user devstack@n-api.service[61596]: INFO oslo.messaging._drivers.impl_rabbit [-] [c9fe375e-0662-4753-bd9b-6f692b9fe078] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 51118. Apr 14 04:46:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-87c5c908-ba57-480d-81b6-244166947fa2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/ips" status: 200 len: 107 microversion: 2.1 time: 0.046461 Apr 14 04:46:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 365/1088] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:46:53 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/ips => generated 107 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:46:54 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-78c3d0e7-59ee-4e89-8928-a4ab215cbd72 req-22cd36a3-a949-45b2-ae0f-15227891171f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f5a130f4-02c3-41fc-bbdb-d2b844e1320b", "tag": "7f00e811-6655-498b-a09b-5a45aba618b4"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:46:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-78c3d0e7-59ee-4e89-8928-a4ab215cbd72 req-22cd36a3-a949-45b2-ae0f-15227891171f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-78c3d0e7-59ee-4e89-8928-a4ab215cbd72 req-22cd36a3-a949-45b2-ae0f-15227891171f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:54 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-78c3d0e7-59ee-4e89-8928-a4ab215cbd72 req-22cd36a3-a949-45b2-ae0f-15227891171f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-78c3d0e7-59ee-4e89-8928-a4ab215cbd72 req-22cd36a3-a949-45b2-ae0f-15227891171f service nova] Creating event network-changed:7f00e811-6655-498b-a09b-5a45aba618b4 for instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b on user Apr 14 04:46:54 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-78c3d0e7-59ee-4e89-8928-a4ab215cbd72 req-22cd36a3-a949-45b2-ae0f-15227891171f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.191975 Apr 14 04:46:54 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 364/1089] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:46:53 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39ce02ae-5c89-4be1-abd2-8c275a9f7af2"}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:46:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:46:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4d9c49c9-e886-422e-80b9-3047d979622f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "POST /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286784 Apr 14 04:46:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 361/1090] 10.0.0.210 () {64 vars in 1400 bytes} [Fri Apr 14 04:46:56 2023] POST /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:05 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lazy-loading 'services' on Instance uuid f5a130f4-02c3-41fc-bbdb-d2b844e1320b {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:47:05 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-6f78e05e-9c46-4c10-9c46-b496239a1516 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments/39ce02ae-5c89-4be1-abd2-8c275a9f7af2" status: 202 len: 0 microversion: 2.1 time: 0.166672 Apr 14 04:47:05 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 366/1091] 10.0.0.210 () {62 vars in 1493 bytes} [Fri Apr 14 04:47:05 2023] DELETE /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments/39ce02ae-5c89-4be1-abd2-8c275a9f7af2 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:05 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:05 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-3babc389-5c0c-4a44-a4fe-d63cedc4e952 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048822 Apr 14 04:47:05 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 365/1092] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:47:05 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=15,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:37 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:37 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-5fe31f0b-68ad-4b14-aca2-70b98ff5efd3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments/a8e6a311-8ecf-435d-a4bd-23726576f9bb" status: 200 len: 194 microversion: 2.20 time: 0.258174 Apr 14 04:47:37 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 362/1093] 10.0.0.210 () {64 vars in 1531 bytes} [Fri Apr 14 04:47:37 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments/a8e6a311-8ecf-435d-a4bd-23726576f9bb => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:37 user devstack@n-api.service[61596]: DEBUG nova.objects.instance [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lazy-loading 'services' on Instance uuid 77f6bb83-54ab-485e-8943-742f2f576607 {{(pid=61596) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:47:37 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-51a5cbea-2d00-4679-881d-63f84c8ccba5 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments/a8e6a311-8ecf-435d-a4bd-23726576f9bb" status: 202 len: 0 microversion: 2.20 time: 0.183495 Apr 14 04:47:37 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 367/1094] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 04:47:37 2023] DELETE /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments/a8e6a311-8ecf-435d-a4bd-23726576f9bb => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:37 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:37 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-2f0daaf3-ccef-4a94-8b89-7632537bc3c3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053299 Apr 14 04:47:37 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 366/1095] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 04:47:37 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:55 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:55 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-5d66d81a-c1a1-421f-8618-f11abf902492 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080474 Apr 14 04:47:55 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 363/1096] 10.0.0.210 () {62 vars in 1379 bytes} [Fri Apr 14 04:47:55 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b/os-volume_attachments => generated 25 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:55 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Going to try to terminate instance {{(pid=61596) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:47:55 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-442642a7-fca0-4a92-adb4-972d55828a3a tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b" status: 204 len: 0 microversion: 2.1 time: 0.124730 Apr 14 04:47:55 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 368/1097] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:47:55 2023] DELETE /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:47:55 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:47:55 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:56 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-4de99f0e-7afb-4dea-ad20-931ceea897b0 req-b1166d20-0592-484f-90fb-796810d4d698 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a130f4-02c3-41fc-bbdb-d2b844e1320b", "name": "network-vif-unplugged", "status": "completed", "tag": "7f00e811-6655-498b-a09b-5a45aba618b4"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:47:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4de99f0e-7afb-4dea-ad20-931ceea897b0 req-b1166d20-0592-484f-90fb-796810d4d698 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4de99f0e-7afb-4dea-ad20-931ceea897b0 req-b1166d20-0592-484f-90fb-796810d4d698 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:56 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-4de99f0e-7afb-4dea-ad20-931ceea897b0 req-b1166d20-0592-484f-90fb-796810d4d698 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:56 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7cab2461ab0d4eb08b62feaf6396bc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '601e2806907a48d3995cc90b54da3c8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:47:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-4de99f0e-7afb-4dea-ad20-931ceea897b0 req-b1166d20-0592-484f-90fb-796810d4d698 service nova] Creating event network-vif-unplugged:7f00e811-6655-498b-a09b-5a45aba618b4 for instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b on user Apr 14 04:47:56 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-957958a5-a8c5-4c39-b7e7-0d73e5acefc3 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b" status: 200 len: 1667 microversion: 2.1 time: 0.248471 Apr 14 04:47:56 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 367/1098] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:47:55 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b => generated 1667 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Apr 14 04:47:56 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-4de99f0e-7afb-4dea-ad20-931ceea897b0 req-b1166d20-0592-484f-90fb-796810d4d698 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038953 Apr 14 04:47:56 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 364/1099] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:47:56 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:47:58 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-45518128-9334-4aa4-895f-f4b4a2371b52 req-9ee68d60-2f8d-4eb1-a2cd-0bac5bb12374 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f5a130f4-02c3-41fc-bbdb-d2b844e1320b", "name": "network-vif-plugged", "status": "completed", "tag": "7f00e811-6655-498b-a09b-5a45aba618b4"}, {"server_uuid": "f5a130f4-02c3-41fc-bbdb-d2b844e1320b", "name": "network-vif-deleted", "tag": "7f00e811-6655-498b-a09b-5a45aba618b4"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:47:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-45518128-9334-4aa4-895f-f4b4a2371b52 req-9ee68d60-2f8d-4eb1-a2cd-0bac5bb12374 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:47:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-45518128-9334-4aa4-895f-f4b4a2371b52 req-9ee68d60-2f8d-4eb1-a2cd-0bac5bb12374 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:47:58 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-45518128-9334-4aa4-895f-f4b4a2371b52 req-9ee68d60-2f8d-4eb1-a2cd-0bac5bb12374 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:47:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-45518128-9334-4aa4-895f-f4b4a2371b52 req-9ee68d60-2f8d-4eb1-a2cd-0bac5bb12374 service nova] Creating event network-vif-plugged:7f00e811-6655-498b-a09b-5a45aba618b4 for instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b on user Apr 14 04:47:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-45518128-9334-4aa4-895f-f4b4a2371b52 req-9ee68d60-2f8d-4eb1-a2cd-0bac5bb12374 service nova] Creating event network-vif-deleted:7f00e811-6655-498b-a09b-5a45aba618b4 for instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b on user Apr 14 04:47:58 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-45518128-9334-4aa4-895f-f4b4a2371b52 req-9ee68d60-2f8d-4eb1-a2cd-0bac5bb12374 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.029594 Apr 14 04:47:58 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 369/1100] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:47:58 2023] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:27 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:27 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-b6c82fae-0c4c-4c09-8726-bbddb604e7e3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047576 Apr 14 04:48:27 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 368/1101] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 04:48:27 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=8 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:28 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Going to try to terminate instance {{(pid=61595) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:48:28 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2ecb48f7-e1a1-414b-85f6-1d2fd82b127c tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 204 len: 0 microversion: 2.20 time: 0.129633 Apr 14 04:48:28 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 365/1102] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:48:28 2023] DELETE /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:48:28 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:48:28 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1d0c2b3b-f315-4040-a0c1-2d81919c1bd8 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 200 len: 1712 microversion: 2.20 time: 0.217870 Apr 14 04:48:28 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 370/1103] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:48:28 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 1712 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:48:28 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-dd9d7956-9837-44b3-b919-5f8fe2c07579 req-bb97c847-5f28-4c23-aa55-33027660deed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-unplugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:48:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-dd9d7956-9837-44b3-b919-5f8fe2c07579 req-bb97c847-5f28-4c23-aa55-33027660deed service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-dd9d7956-9837-44b3-b919-5f8fe2c07579 req-bb97c847-5f28-4c23-aa55-33027660deed service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:28 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-dd9d7956-9837-44b3-b919-5f8fe2c07579 req-bb97c847-5f28-4c23-aa55-33027660deed service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-dd9d7956-9837-44b3-b919-5f8fe2c07579 req-bb97c847-5f28-4c23-aa55-33027660deed service nova] Creating event network-vif-unplugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:48:28 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-dd9d7956-9837-44b3-b919-5f8fe2c07579 req-bb97c847-5f28-4c23-aa55-33027660deed service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032395 Apr 14 04:48:28 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 369/1104] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:48:28 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:48:29 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-cd0aa771-bb46-4b4c-8a6e-df671151f3c5 req-afe73076-bfa3-4399-ab96-1bbe702d2f4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-deleted", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:48:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cd0aa771-bb46-4b4c-8a6e-df671151f3c5 req-afe73076-bfa3-4399-ab96-1bbe702d2f4c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cd0aa771-bb46-4b4c-8a6e-df671151f3c5 req-afe73076-bfa3-4399-ab96-1bbe702d2f4c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:29 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-cd0aa771-bb46-4b4c-8a6e-df671151f3c5 req-afe73076-bfa3-4399-ab96-1bbe702d2f4c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-cd0aa771-bb46-4b4c-8a6e-df671151f3c5 req-afe73076-bfa3-4399-ab96-1bbe702d2f4c service nova] Creating event network-vif-deleted:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:48:29 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-cd0aa771-bb46-4b4c-8a6e-df671151f3c5 req-afe73076-bfa3-4399-ab96-1bbe702d2f4c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033185 Apr 14 04:48:29 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 366/1105] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:48:29 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:48:30 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-c544242f-4f9d-497d-926c-dc763e8f1ae1 req-be813d30-3976-4c25-b9b5-3c7ab1fe756c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "77f6bb83-54ab-485e-8943-742f2f576607", "name": "network-vif-plugged", "status": "completed", "tag": "440e7ef0-4f4c-4923-ab57-8e1ba56dbea3"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:48:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c544242f-4f9d-497d-926c-dc763e8f1ae1 req-be813d30-3976-4c25-b9b5-3c7ab1fe756c service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c544242f-4f9d-497d-926c-dc763e8f1ae1 req-be813d30-3976-4c25-b9b5-3c7ab1fe756c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:30 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-c544242f-4f9d-497d-926c-dc763e8f1ae1 req-be813d30-3976-4c25-b9b5-3c7ab1fe756c service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-c544242f-4f9d-497d-926c-dc763e8f1ae1 req-be813d30-3976-4c25-b9b5-3c7ab1fe756c service nova] Creating event network-vif-plugged:440e7ef0-4f4c-4923-ab57-8e1ba56dbea3 for instance 77f6bb83-54ab-485e-8943-742f2f576607 on user Apr 14 04:48:30 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-c544242f-4f9d-497d-926c-dc763e8f1ae1 req-be813d30-3976-4c25-b9b5-3c7ab1fe756c service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029712 Apr 14 04:48:30 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 371/1106] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:48:30 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:46 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b HTTP/1.1 Apr 14 04:48:46 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:48:46 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:48:46 user devstack@n-api.service[61597]: Connection: close Apr 14 04:48:46 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:48:46 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:48:46 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:48:46 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:48:46 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:46 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:46 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:46 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:48:46 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:48:46 user devstack@n-api.service[61597]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:46 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:46 user devstack@n-api.service[61597]: method: > Apr 14 04:48:46 user devstack@n-api.service[61597]: exception: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:46 user devstack@n-api.service[61597]: action_args: {'id': 'f5a130f4-02c3-41fc-bbdb-d2b844e1320b'} Apr 14 04:48:46 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:46 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:46 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:46 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-11d37352-54f0-4b7a-b030-c63a628f4699 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b" status: 404 len: 111 microversion: 2.1 time: 0.036438 Apr 14 04:48:46 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 370/1107] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:48:46 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:46 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:46 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:46 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-e0292a1a-3e22-4e8c-9038-57dfb4ee8579 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '.version_select at 0x7f538aea4e50>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:46 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-e0292a1a-3e22-4e8c-9038-57dfb4ee8579 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-276811093" status: 202 len: 0 microversion: 2.1 time: 0.030323 Apr 14 04:48:46 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 367/1108] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 04:48:46 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-276811093 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:50 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b HTTP/1.1 Apr 14 04:48:50 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:48:50 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:48:50 user devstack@n-api.service[61596]: Connection: close Apr 14 04:48:50 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:48:50 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:48:50 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:48:50 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:48:50 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:50 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:50 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:50 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:48:50 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:48:50 user devstack@n-api.service[61596]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:50 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:50 user devstack@n-api.service[61596]: method: > Apr 14 04:48:50 user devstack@n-api.service[61596]: exception: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61596]: action_args: {'id': 'f5a130f4-02c3-41fc-bbdb-d2b844e1320b'} Apr 14 04:48:50 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-8390cc6a-f286-404e-8739-b0b80bc870f2 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b" status: 404 len: 111 microversion: 2.1 time: 0.038993 Apr 14 04:48:50 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 372/1109] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:48:50 2023] DELETE /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: f5a130f4-02c3-41fc-bbdb-d2b844e1320b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:50 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:50 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b HTTP/1.1 Apr 14 04:48:50 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:48:50 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:48:50 user devstack@n-api.service[61597]: Connection: close Apr 14 04:48:50 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:48:50 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:48:50 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:48:50 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:48:50 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:50 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:50 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:50 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:48:50 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:48:50 user devstack@n-api.service[61597]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:50 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:50 user devstack@n-api.service[61597]: method: > Apr 14 04:48:50 user devstack@n-api.service[61597]: exception: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61597]: action_args: {'id': 'f5a130f4-02c3-41fc-bbdb-d2b844e1320b'} Apr 14 04:48:50 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. Apr 14 04:48:50 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:50 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance f5a130f4-02c3-41fc-bbdb-d2b844e1320b could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:50 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d8f587a2-8c34-4636-80bb-e687477a88e7 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b" status: 404 len: 111 microversion: 2.1 time: 0.030578 Apr 14 04:48:50 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 371/1110] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:48:50 2023] GET /compute/v2.1/servers/f5a130f4-02c3-41fc-bbdb-d2b844e1320b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:53 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca HTTP/1.1 Apr 14 04:48:53 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:48:53 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:48:53 user devstack@n-api.service[61595]: Connection: close Apr 14 04:48:53 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:48:53 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:48:53 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:48:53 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:48:53 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61595]: method: > Apr 14 04:48:53 user devstack@n-api.service[61595]: exception: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: action_args: {'id': '3d8009dc-c463-41f2-8b36-21862b7ad5ca'} Apr 14 04:48:53 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-246c4345-c9a1-4498-aa03-b73a69353b4f tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca" status: 404 len: 111 microversion: 2.1 time: 0.077296 Apr 14 04:48:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 368/1111] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:48:53 2023] DELETE /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca => generated 111 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 3d8009dc-c463-41f2-8b36-21862b7ad5ca] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:53 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca HTTP/1.1 Apr 14 04:48:53 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:48:53 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:48:53 user devstack@n-api.service[61596]: Connection: close Apr 14 04:48:53 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:48:53 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:48:53 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:48:53 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:48:53 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61596]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:53 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61596]: method: > Apr 14 04:48:53 user devstack@n-api.service[61596]: exception: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61596]: action_args: {'id': '3d8009dc-c463-41f2-8b36-21862b7ad5ca'} Apr 14 04:48:53 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. Apr 14 04:48:53 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 3d8009dc-c463-41f2-8b36-21862b7ad5ca could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:53 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-2ad0336f-38fd-413e-a57f-fec06ad3b038 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca" status: 404 len: 111 microversion: 2.1 time: 0.036301 Apr 14 04:48:53 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 373/1112] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:48:53 2023] GET /compute/v2.1/servers/3d8009dc-c463-41f2-8b36-21862b7ad5ca => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:53 user devstack@n-api.service[61597]: request: DELETE /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 HTTP/1.1 Apr 14 04:48:53 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:48:53 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:48:53 user devstack@n-api.service[61597]: Connection: close Apr 14 04:48:53 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:48:53 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:48:53 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:48:53 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:48:53 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61597]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:53 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61597]: method: > Apr 14 04:48:53 user devstack@n-api.service[61597]: exception: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61597]: action_args: {'id': '6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6'} Apr 14 04:48:53 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:53 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-d0c28022-37cf-4c71-b5c2-a4ec2745bb2b tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6" status: 404 len: 111 microversion: 2.1 time: 0.032178 Apr 14 04:48:53 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 372/1113] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:48:53 2023] DELETE /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:53 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 HTTP/1.1 Apr 14 04:48:53 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:48:53 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:48:53 user devstack@n-api.service[61595]: Connection: close Apr 14 04:48:53 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:48:53 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:48:53 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:48:53 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:48:53 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:53 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:53 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:53 user devstack@n-api.service[61595]: method: > Apr 14 04:48:53 user devstack@n-api.service[61595]: exception: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: action_args: {'id': '6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6'} Apr 14 04:48:53 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. Apr 14 04:48:53 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:48:53 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:53 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-3e84eb44-7e69-4590-9398-61aec89378a4 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6" status: 404 len: 111 microversion: 2.1 time: 0.047066 Apr 14 04:48:53 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 369/1114] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:48:53 2023] GET /compute/v2.1/servers/6a8a0a2f-c4a1-4ee1-a132-0b79bf1f29b6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:57 user devstack@n-api.service[61596]: request: DELETE /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 HTTP/1.1 Apr 14 04:48:57 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:48:57 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:48:57 user devstack@n-api.service[61596]: Connection: close Apr 14 04:48:57 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:48:57 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:48:57 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:48:57 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:48:57 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:57 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:57 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:57 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:48:57 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:48:57 user devstack@n-api.service[61596]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:57 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:57 user devstack@n-api.service[61596]: method: > Apr 14 04:48:57 user devstack@n-api.service[61596]: exception: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61596]: action_args: {'id': '283ef25b-314a-47c1-8414-9d7c737e5115'} Apr 14 04:48:57 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:57 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-861faca9-af7a-4933-9dd7-3d5d16d9c537 tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115" status: 404 len: 111 microversion: 2.1 time: 0.034870 Apr 14 04:48:57 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 374/1115] 10.0.0.210 () {62 vars in 1316 bytes} [Fri Apr 14 04:48:57 2023] DELETE /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] [instance: 283ef25b-314a-47c1-8414-9d7c737e5115] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:48:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] HTTP exception thrown: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Request method failure captured: Apr 14 04:48:57 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 HTTP/1.1 Apr 14 04:48:57 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:48:57 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:48:57 user devstack@n-api.service[61597]: Connection: close Apr 14 04:48:57 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:48:57 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:48:57 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:48:57 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:48:57 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONfhXqpehh2RNupyaDRvW2qdL1RmZ6PZllp2s-_c6Jc4ZvIgrmWdV24ZfibutSPoYMC4eSNZNuCXVH_rKauwrI66GRa8YCL3pUO4kwuFlF0dzufHOGF-ieAR52roOg7L6MkJQVxA8wCEUSTxPTI78xgJs2iHR8GA-M6r-U3AJ0mIrLc Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Project-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/601e2806907a48d3995cc90b54da3c8c"}]}] Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Tenant-Id: 601e2806907a48d3995cc90b54da3c8c Apr 14 04:48:57 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1197484356 Apr 14 04:48:57 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:57 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:48:57 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:48:57 user devstack@n-api.service[61597]: X-User-Id: 7cab2461ab0d4eb08b62feaf6396bc87 Apr 14 04:48:57 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeNegativeTest-1197484356-project-member Apr 14 04:48:57 user devstack@n-api.service[61597]: method: > Apr 14 04:48:57 user devstack@n-api.service[61597]: exception: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61597]: action_args: {'id': '283ef25b-314a-47c1-8414-9d7c737e5115'} Apr 14 04:48:57 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. Apr 14 04:48:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:48:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] Returning 404 to user: Instance 283ef25b-314a-47c1-8414-9d7c737e5115 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:48:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-bd97f396-ee63-4aeb-bb0d-dc15d350f36c tempest-AttachVolumeNegativeTest-1197484356 tempest-AttachVolumeNegativeTest-1197484356-project-member] 10.0.0.210 "GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115" status: 404 len: 111 microversion: 2.1 time: 0.033979 Apr 14 04:48:57 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 373/1116] 10.0.0.210 () {62 vars in 1313 bytes} [Fri Apr 14 04:48:57 2023] GET /compute/v2.1/servers/283ef25b-314a-47c1-8414-9d7c737e5115 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a47febaa-2c63-4fe4-959f-50b1b4f6c071 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Action: 'create', calling method: .version_select at 0x7f538aea72e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-896939964", "metadata": {"Type": "work"}}} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a47febaa-2c63-4fe4-959f-50b1b4f6c071 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Request method failure captured: Apr 14 04:49:02 user devstack@n-api.service[61595]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 04:49:02 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:49:02 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:49:02 user devstack@n-api.service[61595]: Connection: close Apr 14 04:49:02 user devstack@n-api.service[61595]: Content-Length: 121 Apr 14 04:49:02 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:49:02 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:49:02 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:49:02 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONs9ZgvzgT2POAR6349XLZ6XBadtoKReu9-DSk6Gaqt3Uu4iBQLCLPeKwNsxgFeHfR1Br-tUs1qUJeSz6gTKcUMDjTnkCjni_z0bNU_uv2X_dy2wfUvn1oZ89BGiZwIjqnsFBSkMuziiMpX3DvBufFmleyEi0iL2ESV-jnp0ZjvlghI Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1fea321629447628b197983759ad1b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}] Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Id: c82ebd51dce84cc3be952e6bdaca2ba4 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61595]: Apr 14 04:49:02 user devstack@n-api.service[61595]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-896939964", "metadata": {"Type": "work"}}} Apr 14 04:49:02 user devstack@n-api.service[61595]: method: Apr 14 04:49:02 user devstack@n-api.service[61595]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61595]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-896939964', 'metadata': {'Type': 'work'}}}} Apr 14 04:49:02 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise error Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi '#$%' Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-a47febaa-2c63-4fe4-959f-50b1b4f6c071 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:49:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-a47febaa-2c63-4fe4-959f-50b1b4f6c071 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.211818 Apr 14 04:49:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 370/1117] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 04:49:01 2023] POST /compute/v2.1/os-volumes => generated 127 bytes in 214 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8e9aa475-3543-44fe-ac29-789fce8a8316 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Action: 'create', calling method: .version_select at 0x7f538aad3010>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-732919119", "metadata": {"Type": "work"}}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8e9aa475-3543-44fe-ac29-789fce8a8316 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Request method failure captured: Apr 14 04:49:02 user devstack@n-api.service[61596]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 04:49:02 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:49:02 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:49:02 user devstack@n-api.service[61596]: Connection: close Apr 14 04:49:02 user devstack@n-api.service[61596]: Content-Length: 119 Apr 14 04:49:02 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:49:02 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:49:02 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:49:02 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONs9ZgvzgT2POAR6349XLZ6XBadtoKReu9-DSk6Gaqt3Uu4iBQLCLPeKwNsxgFeHfR1Br-tUs1qUJeSz6gTKcUMDjTnkCjni_z0bNU_uv2X_dy2wfUvn1oZ89BGiZwIjqnsFBSkMuziiMpX3DvBufFmleyEi0iL2ESV-jnp0ZjvlghI Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1fea321629447628b197983759ad1b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}] Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Tenant-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Id: c82ebd51dce84cc3be952e6bdaca2ba4 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61596]: Apr 14 04:49:02 user devstack@n-api.service[61596]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-732919119", "metadata": {"Type": "work"}}} Apr 14 04:49:02 user devstack@n-api.service[61596]: method: Apr 14 04:49:02 user devstack@n-api.service[61596]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 04:49:02 user devstack@n-api.service[61596]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-732919119', 'metadata': {'Type': 'work'}}}} Apr 14 04:49:02 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise error Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi '0' Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-8e9aa475-3543-44fe-ac29-789fce8a8316 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:49:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-8e9aa475-3543-44fe-ac29-789fce8a8316 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012593 Apr 14 04:49:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 375/1118] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 04:49:02 2023] POST /compute/v2.1/os-volumes => generated 125 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9edd8337-2d7d-4cf5-b36a-aadc6da67920 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Action: 'create', calling method: .version_select at 0x7f538acb5a20>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-363858491", "metadata": {"Type": "work"}}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9edd8337-2d7d-4cf5-b36a-aadc6da67920 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Request method failure captured: Apr 14 04:49:02 user devstack@n-api.service[61597]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Apr 14 04:49:02 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:49:02 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:49:02 user devstack@n-api.service[61597]: Connection: close Apr 14 04:49:02 user devstack@n-api.service[61597]: Content-Length: 118 Apr 14 04:49:02 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:49:02 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:49:02 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:49:02 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONs9ZgvzgT2POAR6349XLZ6XBadtoKReu9-DSk6Gaqt3Uu4iBQLCLPeKwNsxgFeHfR1Br-tUs1qUJeSz6gTKcUMDjTnkCjni_z0bNU_uv2X_dy2wfUvn1oZ89BGiZwIjqnsFBSkMuziiMpX3DvBufFmleyEi0iL2ESV-jnp0ZjvlghI Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Project-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Project-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1fea321629447628b197983759ad1b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}] Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Tenant: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Tenant-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61597]: X-User: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61597]: X-User-Id: c82ebd51dce84cc3be952e6bdaca2ba4 Apr 14 04:49:02 user devstack@n-api.service[61597]: X-User-Name: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61597]: Apr 14 04:49:02 user devstack@n-api.service[61597]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-363858491", "metadata": {"Type": "work"}}} Apr 14 04:49:02 user devstack@n-api.service[61597]: method: Apr 14 04:49:02 user devstack@n-api.service[61597]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61597]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-363858491', 'metadata': {'Type': 'work'}}}} Apr 14 04:49:02 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/jsonschema/validators.py", line 314, in validate Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise error Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi On instance['volume']: Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi '' Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Apr 14 04:49:02 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9edd8337-2d7d-4cf5-b36a-aadc6da67920 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:49:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9edd8337-2d7d-4cf5-b36a-aadc6da67920 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011233 Apr 14 04:49:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 374/1119] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 04:49:02 2023] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-65481de5-b27c-4c42-97d2-73b6c3597a09 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Calling method '.version_select at 0x7f538ac1cb80>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:49:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-65481de5-b27c-4c42-97d2-73b6c3597a09 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] HTTP exception thrown: Volume tempest-invalid-1073976036 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-65481de5-b27c-4c42-97d2-73b6c3597a09 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Request method failure captured: Apr 14 04:49:02 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1073976036 HTTP/1.1 Apr 14 04:49:02 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:49:02 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:49:02 user devstack@n-api.service[61595]: Connection: close Apr 14 04:49:02 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:49:02 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:49:02 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:49:02 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:49:02 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONs9ZgvzgT2POAR6349XLZ6XBadtoKReu9-DSk6Gaqt3Uu4iBQLCLPeKwNsxgFeHfR1Br-tUs1qUJeSz6gTKcUMDjTnkCjni_z0bNU_uv2X_dy2wfUvn1oZ89BGiZwIjqnsFBSkMuziiMpX3DvBufFmleyEi0iL2ESV-jnp0ZjvlghI Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1fea321629447628b197983759ad1b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}] Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Id: c82ebd51dce84cc3be952e6bdaca2ba4 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61595]: method: Apr 14 04:49:02 user devstack@n-api.service[61595]: exception: Volume tempest-invalid-1073976036 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: action_args: {'id': 'tempest-invalid-1073976036'} Apr 14 04:49:02 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1073976036 could not be found. (HTTP 404) (Request-ID: req-0fa91a30-116a-4360-82be-ba63a1a98803) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1073976036 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1073976036 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1073976036 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-65481de5-b27c-4c42-97d2-73b6c3597a09 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Returning 404 to user: Volume tempest-invalid-1073976036 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:49:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-65481de5-b27c-4c42-97d2-73b6c3597a09 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1073976036" status: 404 len: 99 microversion: 2.1 time: 0.168938 Apr 14 04:49:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 371/1120] 10.0.0.210 () {62 vars in 1295 bytes} [Fri Apr 14 04:49:02 2023] DELETE /compute/v2.1/os-volumes/tempest-invalid-1073976036 => generated 99 bytes in 170 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-fcca974c-6ebb-4cc3-b822-2171f2d67912 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004696 Apr 14 04:49:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 376/1121] 10.0.0.210 () {62 vars in 1217 bytes} [Fri Apr 14 04:49:02 2023] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-36a578f7-c194-4b67-8454-798221e36e25 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004424 Apr 14 04:49:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 375/1122] 10.0.0.210 () {62 vars in 1214 bytes} [Fri Apr 14 04:49:02 2023] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2e29e4ef-5b77-4986-9832-e20698cd3ef5 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Calling method '.version_select at 0x7f538aea7130>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:49:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-2e29e4ef-5b77-4986-9832-e20698cd3ef5 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] HTTP exception thrown: Volume 07ceef27-6a7a-4d2e-b202-61914a12fd25 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2e29e4ef-5b77-4986-9832-e20698cd3ef5 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Request method failure captured: Apr 14 04:49:02 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/os-volumes/07ceef27-6a7a-4d2e-b202-61914a12fd25 HTTP/1.1 Apr 14 04:49:02 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:49:02 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:49:02 user devstack@n-api.service[61595]: Connection: close Apr 14 04:49:02 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:49:02 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:49:02 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:49:02 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:49:02 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONs9ZgvzgT2POAR6349XLZ6XBadtoKReu9-DSk6Gaqt3Uu4iBQLCLPeKwNsxgFeHfR1Br-tUs1qUJeSz6gTKcUMDjTnkCjni_z0bNU_uv2X_dy2wfUvn1oZ89BGiZwIjqnsFBSkMuziiMpX3DvBufFmleyEi0iL2ESV-jnp0ZjvlghI Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1fea321629447628b197983759ad1b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}] Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Id: c82ebd51dce84cc3be952e6bdaca2ba4 Apr 14 04:49:02 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61595]: method: Apr 14 04:49:02 user devstack@n-api.service[61595]: exception: Volume 07ceef27-6a7a-4d2e-b202-61914a12fd25 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: action_args: {'id': '07ceef27-6a7a-4d2e-b202-61914a12fd25'} Apr 14 04:49:02 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07ceef27-6a7a-4d2e-b202-61914a12fd25 could not be found. (HTTP 404) (Request-ID: req-b0e3d7ba-b55d-4d22-a24e-81033983c4ec) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._delete(loc) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 313, in _delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 229, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07ceef27-6a7a-4d2e-b202-61914a12fd25 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07ceef27-6a7a-4d2e-b202-61914a12fd25 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07ceef27-6a7a-4d2e-b202-61914a12fd25 could not be found. Apr 14 04:49:02 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-2e29e4ef-5b77-4986-9832-e20698cd3ef5 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Returning 404 to user: Volume 07ceef27-6a7a-4d2e-b202-61914a12fd25 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:49:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-2e29e4ef-5b77-4986-9832-e20698cd3ef5 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/07ceef27-6a7a-4d2e-b202-61914a12fd25" status: 404 len: 109 microversion: 2.1 time: 0.033859 Apr 14 04:49:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 372/1123] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:49:02 2023] DELETE /compute/v2.1/os-volumes/07ceef27-6a7a-4d2e-b202-61914a12fd25 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:49:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4ef063fe-9c0c-459f-910a-a2d3ed0a3b00 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Calling method '.version_select at 0x7f538a941900>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:49:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-4ef063fe-9c0c-459f-910a-a2d3ed0a3b00 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] HTTP exception thrown: Volume 01bd524c-1bf3-4931-81e4-3ae82cd3b12f could not be found. Apr 14 04:49:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4ef063fe-9c0c-459f-910a-a2d3ed0a3b00 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Request method failure captured: Apr 14 04:49:02 user devstack@n-api.service[61596]: request: GET /compute/v2.1/os-volumes/01bd524c-1bf3-4931-81e4-3ae82cd3b12f HTTP/1.1 Apr 14 04:49:02 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:49:02 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:49:02 user devstack@n-api.service[61596]: Connection: close Apr 14 04:49:02 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:49:02 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:49:02 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:49:02 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:49:02 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONs9ZgvzgT2POAR6349XLZ6XBadtoKReu9-DSk6Gaqt3Uu4iBQLCLPeKwNsxgFeHfR1Br-tUs1qUJeSz6gTKcUMDjTnkCjni_z0bNU_uv2X_dy2wfUvn1oZ89BGiZwIjqnsFBSkMuziiMpX3DvBufFmleyEi0iL2ESV-jnp0ZjvlghI Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Project-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/f1fea321629447628b197983759ad1b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/f1fea321629447628b197983759ad1b3"}]}] Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Tenant: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Tenant-Id: f1fea321629447628b197983759ad1b3 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-VolumesNegativeTest-570366362 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Id: c82ebd51dce84cc3be952e6bdaca2ba4 Apr 14 04:49:02 user devstack@n-api.service[61596]: X-User-Name: tempest-VolumesNegativeTest-570366362-project-member Apr 14 04:49:02 user devstack@n-api.service[61596]: method: Apr 14 04:49:02 user devstack@n-api.service[61596]: exception: Volume 01bd524c-1bf3-4931-81e4-3ae82cd3b12f could not be found. Apr 14 04:49:02 user devstack@n-api.service[61596]: action_args: {'id': '01bd524c-1bf3-4931-81e4-3ae82cd3b12f'} Apr 14 04:49:02 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 01bd524c-1bf3-4931-81e4-3ae82cd3b12f could not be found. (HTTP 404) (Request-ID: req-b181aa59-e35f-472c-b290-b667227dc2c7) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 01bd524c-1bf3-4931-81e4-3ae82cd3b12f could not be found. Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 01bd524c-1bf3-4931-81e4-3ae82cd3b12f could not be found. Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 01bd524c-1bf3-4931-81e4-3ae82cd3b12f could not be found. Apr 14 04:49:02 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:49:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4ef063fe-9c0c-459f-910a-a2d3ed0a3b00 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] Returning 404 to user: Volume 01bd524c-1bf3-4931-81e4-3ae82cd3b12f could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:49:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4ef063fe-9c0c-459f-910a-a2d3ed0a3b00 tempest-VolumesNegativeTest-570366362 tempest-VolumesNegativeTest-570366362-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/01bd524c-1bf3-4931-81e4-3ae82cd3b12f" status: 404 len: 109 microversion: 2.1 time: 0.170637 Apr 14 04:49:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 377/1124] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:49:02 2023] GET /compute/v2.1/os-volumes/01bd524c-1bf3-4931-81e4-3ae82cd3b12f => generated 109 bytes in 172 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=8 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:49:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] HTTP exception thrown: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Request method failure captured: Apr 14 04:49:18 user devstack@n-api.service[61597]: request: GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 HTTP/1.1 Apr 14 04:49:18 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:49:18 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:49:18 user devstack@n-api.service[61597]: Connection: close Apr 14 04:49:18 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:49:18 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:49:18 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:49:18 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:49:18 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONmVY7u7UHxiRj8u79eXyR6i-yzdJ5tgnlOHHv5T14yGQAspWR8OMT770BJZdj7M7A_NCBPAkSGG7wWmGsEheIPwXyv57YpGn5J0dQ5iJwwOrOL-Iw8KGXkK6awZDXWtHjPcPXaPdCe6DQCup0w59kir5SyqZkdJLIlY_jaVS5eljao Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Project-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}] Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Tenant-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:49:18 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:49:18 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:49:18 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:49:18 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:49:18 user devstack@n-api.service[61597]: X-User-Id: 67d6c699fc524554a6f4983af91d58fc Apr 14 04:49:18 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:49:18 user devstack@n-api.service[61597]: method: > Apr 14 04:49:18 user devstack@n-api.service[61597]: exception: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:49:18 user devstack@n-api.service[61597]: action_args: {'id': '77f6bb83-54ab-485e-8943-742f2f576607'} Apr 14 04:49:18 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:49:18 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:49:18 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Returning 404 to user: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:49:18 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-ee05d815-153d-4616-b11a-885b3917e1bb tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 404 len: 111 microversion: 2.20 time: 0.035157 Apr 14 04:49:18 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 376/1125] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:49:18 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:49:18 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=7,nova_api:DELETE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:18 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:18 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-b6a39584-7179-4580-bab2-3401a6b9dd0a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '.version_select at 0x7f538aea71c0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:49:18 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-b6a39584-7179-4580-bab2-3401a6b9dd0a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996810505" status: 204 len: 0 microversion: 2.20 time: 0.033238 Apr 14 04:49:18 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 373/1126] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 04:49:18 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996810505 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:49:19 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:19 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:49:19 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-16b4a0dd-5155-4b97-92f8-98764e6525ab tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'create', calling method: .version_select at 0x7f538a9408b0>, body: {"keypair": {"name": "tempest-keypair-1115532707", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIz9kPiXrU+d9YNNeLmDz42lc/lqPHsJkMzNHXLJ9BxaT3PcpDfhDBMRUsgkcRE+o41EINj1zxZFQZUWhpX4XIsgWigDmt6Wb2qr1dlIExZrdUiB9GwXx8T2hNCZNX55JA=="}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:19 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-16b4a0dd-5155-4b97-92f8-98764e6525ab tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:49:19 user devstack@n-api.service[61596]: DEBUG nova.quota [None req-16b4a0dd-5155-4b97-92f8-98764e6525ab tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for user 67d6c699fc524554a6f4983af91d58fc and project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'key_pairs'} {{(pid=61596) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:49:19 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-16b4a0dd-5155-4b97-92f8-98764e6525ab tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.058115 Apr 14 04:49:19 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 378/1127] 10.0.0.210 () {66 vars in 1277 bytes} [Fri Apr 14 04:49:19 2023] POST /compute/v2.1/os-keypairs => generated 401 bytes in 60 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Apr 14 04:49:20 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-203487374", "imageRef": "5c55a1da-f6f8-4442-939b-f0cb72ea4327", "flavorRef": "42", "adminPass": "***", "networks": [{"uuid": "4c4f373b-6540-48ea-815b-d4930f403496"}], "security_groups": [{"name": "tempest-securitygroup--842847775"}], "key_name": "tempest-keypair-1115532707", "user_data": "}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.network.neutron [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] validate_networks() for [('4c4f373b-6540-48ea-815b-d4930f403496', None, None, None, None, None)] {{(pid=61597) validate_networks /opt/stack/nova/nova/network/neutron.py:2636}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Flavor limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Image limits 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Flavor pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Image pref 0:0:0 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.virt.hardware [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=61597) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:393}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.quota [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Getting quotas for user 67d6c699fc524554a6f4983af91d58fc and project c10c8cf348e04e44afbaae93a4b60e36. Resources: {'ram', 'instances', 'cores'} {{(pid=61597) _get_quotas /opt/stack/nova/nova/quota.py:383}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Going to run 1 instances... {{(pid=61597) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Apr 14 04:49:21 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='5c55a1da-f6f8-4442-939b-f0cb72ea4327',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=61597) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Apr 14 04:49:21 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9328b939-a1bb-4d47-8c17-e1bb683b347b tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.20 time: 0.615499 Apr 14 04:49:21 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 377/1128] 10.0.0.210 () {66 vars in 1265 bytes} [Fri Apr 14 04:49:20 2023] POST /compute/v2.1/servers => generated 399 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 452 bytes (1 switches on core 0) Apr 14 04:49:21 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-e2122c2f-fd0a-423e-85e2-b817780994b3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:49:21 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-e2122c2f-fd0a-423e-85e2-b817780994b3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:49:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-e2122c2f-fd0a-423e-85e2-b817780994b3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:49:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-e2122c2f-fd0a-423e-85e2-b817780994b3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:49:21 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-e2122c2f-fd0a-423e-85e2-b817780994b3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:49:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-e2122c2f-fd0a-423e-85e2-b817780994b3 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 200 len: 1275 microversion: 2.20 time: 0.086474 Apr 14 04:49:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 374/1129] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:49:21 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 1275 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:49:24 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-b3b9b306-f3b0-4f1e-8bdf-89d7bdafab37 req-440e5c88-b97f-4737-a94e-65cfc04d9071 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b3b9b306-f3b0-4f1e-8bdf-89d7bdafab37 req-440e5c88-b97f-4737-a94e-65cfc04d9071 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:49:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b3b9b306-f3b0-4f1e-8bdf-89d7bdafab37 req-440e5c88-b97f-4737-a94e-65cfc04d9071 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:49:24 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-b3b9b306-f3b0-4f1e-8bdf-89d7bdafab37 req-440e5c88-b97f-4737-a94e-65cfc04d9071 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:49:24 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-b3b9b306-f3b0-4f1e-8bdf-89d7bdafab37 req-440e5c88-b97f-4737-a94e-65cfc04d9071 service nova] Creating event network-changed:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:49:24 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-b3b9b306-f3b0-4f1e-8bdf-89d7bdafab37 req-440e5c88-b97f-4737-a94e-65cfc04d9071 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.144976 Apr 14 04:49:24 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 379/1130] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:49:24 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:49:26 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-a55a28e2-7a55-4a8d-94a1-fe2f3ae35b13 req-93b6ec7b-be68-4226-a5fb-79e60743d61e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-plugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a55a28e2-7a55-4a8d-94a1-fe2f3ae35b13 req-93b6ec7b-be68-4226-a5fb-79e60743d61e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:49:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a55a28e2-7a55-4a8d-94a1-fe2f3ae35b13 req-93b6ec7b-be68-4226-a5fb-79e60743d61e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:49:26 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-a55a28e2-7a55-4a8d-94a1-fe2f3ae35b13 req-93b6ec7b-be68-4226-a5fb-79e60743d61e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:49:26 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-a55a28e2-7a55-4a8d-94a1-fe2f3ae35b13 req-93b6ec7b-be68-4226-a5fb-79e60743d61e service nova] Creating event network-vif-plugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:49:26 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-a55a28e2-7a55-4a8d-94a1-fe2f3ae35b13 req-93b6ec7b-be68-4226-a5fb-79e60743d61e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036014 Apr 14 04:49:26 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 378/1131] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:49:26 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:49:28 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-6afab1d7-5377-4ce6-bd84-7552be8bf523 req-d812bff4-b363-4eba-a9a0-c08771b942d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-plugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:49:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-6afab1d7-5377-4ce6-bd84-7552be8bf523 req-d812bff4-b363-4eba-a9a0-c08771b942d0 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:49:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-6afab1d7-5377-4ce6-bd84-7552be8bf523 req-d812bff4-b363-4eba-a9a0-c08771b942d0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:49:28 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-6afab1d7-5377-4ce6-bd84-7552be8bf523 req-d812bff4-b363-4eba-a9a0-c08771b942d0 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:49:28 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-6afab1d7-5377-4ce6-bd84-7552be8bf523 req-d812bff4-b363-4eba-a9a0-c08771b942d0 service nova] Creating event network-vif-plugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:49:28 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-6afab1d7-5377-4ce6-bd84-7552be8bf523 req-d812bff4-b363-4eba-a9a0-c08771b942d0 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031469 Apr 14 04:49:28 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 375/1132] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:49:28 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell0:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=13,nova_api:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:50:11 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:50:11 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-1176e798-edaf-4dbe-8ffc-d6430944b4ac tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 200 len: 1587 microversion: 2.20 time: 0.195703 Apr 14 04:50:11 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 380/1133] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:50:11 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 1587 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:51:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell0:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:11 user devstack@n-api.service[61597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 04:51:11 user devstack@n-api.service[61597]: Fri Apr 14 04:51:11 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-interface (ip 10.0.0.210) !!! Apr 14 04:51:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=19,nova_api:INSERT=3 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:11 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:12 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:12 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-16ae4265-c1b4-4900-a72f-7db1539fbadf tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-interface" status: 200 len: 283 microversion: 2.20 time: 0.170917 Apr 14 04:51:12 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 379/1134] 10.0.0.210 () {64 vars in 1393 bytes} [Fri Apr 14 04:51:11 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-interface => generated 283 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:51:12 user devstack@n-api.service[61595]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e825e685-f8f3-40f4-93e8-6105858cca89] AMQP server on 10.0.0.210:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Apr 14 04:51:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell0:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:12 user devstack@n-api.service[61595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 04:51:12 user devstack@n-api.service[61595]: Fri Apr 14 04:51:12 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.0.0.210) !!! Apr 14 04:51:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=9,nova_api:DELETE=1 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:12 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:51:12 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-ad58e192-328a-4276-ba1e-6c345ddd275a req-d2f7ea21-0a2b-425e-9206-f5f845c41e1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:51:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ad58e192-328a-4276-ba1e-6c345ddd275a req-d2f7ea21-0a2b-425e-9206-f5f845c41e1f service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ad58e192-328a-4276-ba1e-6c345ddd275a req-d2f7ea21-0a2b-425e-9206-f5f845c41e1f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:12 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-ad58e192-328a-4276-ba1e-6c345ddd275a req-d2f7ea21-0a2b-425e-9206-f5f845c41e1f service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-ad58e192-328a-4276-ba1e-6c345ddd275a req-d2f7ea21-0a2b-425e-9206-f5f845c41e1f service nova] Creating event network-changed:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:51:13 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-ad58e192-328a-4276-ba1e-6c345ddd275a req-d2f7ea21-0a2b-425e-9206-f5f845c41e1f service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055961 Apr 14 04:51:13 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 376/1135] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:51:12 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:13 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:13 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5547e3fc-1f28-400e-a2a3-bf2ce52274f9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/ips" status: 200 len: 111 microversion: 2.20 time: 0.040432 Apr 14 04:51:13 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 381/1136] 10.0.0.210 () {64 vars in 1366 bytes} [Fri Apr 14 04:51:13 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/ips => generated 111 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:15 user devstack@n-api.service[61597]: DEBUG nova.objects.instance [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lazy-loading 'flavor' on Instance uuid 068de634-b290-46ae-b5a2-ef36165cd23b {{(pid=61597) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Apr 14 04:51:16 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-9c0495b0-3f51-4c38-9781-0e79bd5f2c7e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/action" status: 202 len: 0 microversion: 2.20 time: 0.990851 Apr 14 04:51:16 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 380/1137] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:51:15 2023] POST /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/action => generated 0 bytes in 993 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:16 user devstack@n-api.service[61595]: INFO oslo.messaging._drivers.impl_rabbit [-] [e825e685-f8f3-40f4-93e8-6105858cca89] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 52306. Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:51:16 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:51:16 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-bbbfb246-fbf6-4cdb-905a-72f7b568fc6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 200 len: 1712 microversion: 2.20 time: 0.286722 Apr 14 04:51:16 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 377/1138] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:51:16 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 1712 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:51:16 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-36a756dd-ce6e-4911-95c0-08b86a401b27 req-59d2698c-6caf-4bed-95ad-dbc1fe18e421 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-unplugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:51:16 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-36a756dd-ce6e-4911-95c0-08b86a401b27 req-59d2698c-6caf-4bed-95ad-dbc1fe18e421 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-36a756dd-ce6e-4911-95c0-08b86a401b27 req-59d2698c-6caf-4bed-95ad-dbc1fe18e421 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-36a756dd-ce6e-4911-95c0-08b86a401b27 req-59d2698c-6caf-4bed-95ad-dbc1fe18e421 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-36a756dd-ce6e-4911-95c0-08b86a401b27 req-59d2698c-6caf-4bed-95ad-dbc1fe18e421 service nova] Creating event network-vif-unplugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:51:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-36a756dd-ce6e-4911-95c0-08b86a401b27 req-59d2698c-6caf-4bed-95ad-dbc1fe18e421 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029262 Apr 14 04:51:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 382/1139] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:51:16 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:51:19 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-6df4f61d-bddb-45a5-8e32-d920377b0680 req-7bf1f743-df17-4039-bcb4-fa1c4e695a1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-plugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:51:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-6df4f61d-bddb-45a5-8e32-d920377b0680 req-7bf1f743-df17-4039-bcb4-fa1c4e695a1d service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-6df4f61d-bddb-45a5-8e32-d920377b0680 req-7bf1f743-df17-4039-bcb4-fa1c4e695a1d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-6df4f61d-bddb-45a5-8e32-d920377b0680 req-7bf1f743-df17-4039-bcb4-fa1c4e695a1d service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-6df4f61d-bddb-45a5-8e32-d920377b0680 req-7bf1f743-df17-4039-bcb4-fa1c4e695a1d service nova] Creating event network-vif-plugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:51:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-6df4f61d-bddb-45a5-8e32-d920377b0680 req-7bf1f743-df17-4039-bcb4-fa1c4e695a1d service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036309 Apr 14 04:51:19 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 381/1140] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:51:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:51:21 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-daa4f8c1-4457-4892-ba44-ca0699d29715 req-e3c0f237-f7d3-4c14-a76f-f11b9f293b35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:51:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-daa4f8c1-4457-4892-ba44-ca0699d29715 req-e3c0f237-f7d3-4c14-a76f-f11b9f293b35 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:51:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-daa4f8c1-4457-4892-ba44-ca0699d29715 req-e3c0f237-f7d3-4c14-a76f-f11b9f293b35 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:51:21 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-daa4f8c1-4457-4892-ba44-ca0699d29715 req-e3c0f237-f7d3-4c14-a76f-f11b9f293b35 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:51:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-daa4f8c1-4457-4892-ba44-ca0699d29715 req-e3c0f237-f7d3-4c14-a76f-f11b9f293b35 service nova] Creating event network-changed:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:51:21 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-daa4f8c1-4457-4892-ba44-ca0699d29715 req-e3c0f237-f7d3-4c14-a76f-f11b9f293b35 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028847 Apr 14 04:51:21 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 378/1141] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:51:21 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:52:06 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:52:06 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=12 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:52:07 user devstack@n-api.service[61596]: DEBUG nova.policy [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61596) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:52:07 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-a304dbd7-b1e8-405a-b633-51a5fc3b8f16 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 200 len: 1653 microversion: 2.20 time: 0.175784 Apr 14 04:52:07 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 383/1142] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:52:06 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 1653 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:53:07 user devstack@n-api.service[61597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 04:53:07 user devstack@n-api.service[61597]: Fri Apr 14 04:53:07 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments (ip 10.0.0.210) !!! Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=6 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=21,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4373e616-f91b-4891-aa6c-750892ae43b5"}} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:07 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:07 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-f5b77aeb-c471-4bf1-ba8f-95fc0c1e8658 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.640317 Apr 14 04:53:07 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 382/1143] 10.0.0.210 () {66 vars in 1441 bytes} [Fri Apr 14 04:53:07 2023] POST /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments => generated 188 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Apr 14 04:53:08 user devstack@n-api.service[61595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 04:53:08 user devstack@n-api.service[61595]: Fri Apr 14 04:53:08 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments/4373e616-f91b-4891-aa6c-750892ae43b5 (ip 10.0.0.210) !!! Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=10 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:08 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:08 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-4056403b-e2bc-4e6f-91de-aa23b93ca2f7 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments/4373e616-f91b-4891-aa6c-750892ae43b5" status: 202 len: 0 microversion: 2.20 time: 0.262415 Apr 14 04:53:08 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 379/1144] 10.0.0.210 () {64 vars in 1534 bytes} [Fri Apr 14 04:53:08 2023] DELETE /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments/4373e616-f91b-4891-aa6c-750892ae43b5 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=2 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=6 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:08 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=61596) unshelve /opt/stack/nova/nova/compute/api.py:4596}} Apr 14 04:53:08 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-c4b7373a-6318-4a02-b4ed-29a96c3fcf0e tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "POST /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/action" status: 202 len: 0 microversion: 2.20 time: 0.110696 Apr 14 04:53:08 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 384/1145] 10.0.0.210 () {66 vars in 1396 bytes} [Fri Apr 14 04:53:08 2023] POST /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:53:08 user devstack@n-api.service[61597]: DEBUG nova.policy [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61597) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:53:08 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-1a1e2289-fc59-4fdd-b72a-f7ed9d3e9fb9 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 200 len: 1661 microversion: 2.20 time: 0.227331 Apr 14 04:53:08 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 383/1146] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:53:08 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 1661 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:53:10 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-667a040a-15eb-493c-9e9f-0ae8df92cddb req-ae64a96d-b84b-4f32-b6fc-fa4c35318365 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:53:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-667a040a-15eb-493c-9e9f-0ae8df92cddb req-ae64a96d-b84b-4f32-b6fc-fa4c35318365 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-667a040a-15eb-493c-9e9f-0ae8df92cddb req-ae64a96d-b84b-4f32-b6fc-fa4c35318365 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:10 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-667a040a-15eb-493c-9e9f-0ae8df92cddb req-ae64a96d-b84b-4f32-b6fc-fa4c35318365 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-667a040a-15eb-493c-9e9f-0ae8df92cddb req-ae64a96d-b84b-4f32-b6fc-fa4c35318365 service nova] Creating event network-changed:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:53:10 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-667a040a-15eb-493c-9e9f-0ae8df92cddb req-ae64a96d-b84b-4f32-b6fc-fa4c35318365 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029061 Apr 14 04:53:10 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 380/1147] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:53:10 2023] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:53:17 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-68ab0931-6d3f-4b97-a71f-f3eaeac68a0a req-31052a73-716e-4afc-9753-41b977cae982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-plugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:53:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-68ab0931-6d3f-4b97-a71f-f3eaeac68a0a req-31052a73-716e-4afc-9753-41b977cae982 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-68ab0931-6d3f-4b97-a71f-f3eaeac68a0a req-31052a73-716e-4afc-9753-41b977cae982 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:17 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-68ab0931-6d3f-4b97-a71f-f3eaeac68a0a req-31052a73-716e-4afc-9753-41b977cae982 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-68ab0931-6d3f-4b97-a71f-f3eaeac68a0a req-31052a73-716e-4afc-9753-41b977cae982 service nova] Creating event network-vif-plugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:53:17 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-68ab0931-6d3f-4b97-a71f-f3eaeac68a0a req-31052a73-716e-4afc-9753-41b977cae982 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097137 Apr 14 04:53:17 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 385/1148] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:53:17 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:53:19 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-f0918c56-ec8a-4afe-8be7-b9c1131fe897 req-cc64562d-5176-4bbb-afc8-3eac47a8f49b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-plugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:53:19 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:19 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=21,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f0918c56-ec8a-4afe-8be7-b9c1131fe897 req-cc64562d-5176-4bbb-afc8-3eac47a8f49b service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f0918c56-ec8a-4afe-8be7-b9c1131fe897 req-cc64562d-5176-4bbb-afc8-3eac47a8f49b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:19 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-f0918c56-ec8a-4afe-8be7-b9c1131fe897 req-cc64562d-5176-4bbb-afc8-3eac47a8f49b service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-f0918c56-ec8a-4afe-8be7-b9c1131fe897 req-cc64562d-5176-4bbb-afc8-3eac47a8f49b service nova] Creating event network-vif-plugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:53:19 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-f0918c56-ec8a-4afe-8be7-b9c1131fe897 req-cc64562d-5176-4bbb-afc8-3eac47a8f49b service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036437 Apr 14 04:53:19 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 384/1149] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:53:19 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=17,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:53:58 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:53:58 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-318c664c-4079-4939-af27-2a31641ade25 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 200 len: 1706 microversion: 2.20 time: 0.166744 Apr 14 04:53:58 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 381/1150] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:53:58 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 1706 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:54:59 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:54:59 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4810daa8-fe6d-47c5-8902-bbb93d56ce6f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052508 Apr 14 04:54:59 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 386/1151] 10.0.0.210 () {64 vars in 1420 bytes} [Fri Apr 14 04:54:59 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Apr 14 04:54:59 user devstack@n-api.service[61597]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 04:54:59 user devstack@n-api.service[61597]: Fri Apr 14 04:54:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b (ip 10.0.0.210) !!! Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=2 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:54:59 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Going to try to terminate instance {{(pid=61597) delete /opt/stack/nova/nova/compute/api.py:2721}} Apr 14 04:54:59 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-624dcbc6-fd7c-47ef-b2cb-6d1eecf8cb67 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 204 len: 0 microversion: 2.20 time: 0.129372 Apr 14 04:54:59 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 385/1152] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:54:59 2023] DELETE /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=2 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=6 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:54:59 user devstack@n-api.service[61595]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Apr 14 04:54:59 user devstack@n-api.service[61595]: Fri Apr 14 04:54:59 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b (ip 10.0.0.210) !!! Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:54:59 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:00 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:55:00 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:55:00 user devstack@n-api.service[61595]: DEBUG nova.policy [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '67d6c699fc524554a6f4983af91d58fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c10c8cf348e04e44afbaae93a4b60e36', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=61595) authorize /opt/stack/nova/nova/policy.py:203}} Apr 14 04:55:00 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [req-6bf28e45-2706-41a1-85e6-98a9bba52ff6 req-dfebed9e-701b-4a46-b749-054a041411be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-unplugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:55:00 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-8b1ae296-ce91-4dea-b0ac-f0c0c6c104b4 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 200 len: 1712 microversion: 2.20 time: 0.724581 Apr 14 04:55:00 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 382/1153] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:54:59 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 1712 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Apr 14 04:55:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6bf28e45-2706-41a1-85e6-98a9bba52ff6 req-dfebed9e-701b-4a46-b749-054a041411be service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6bf28e45-2706-41a1-85e6-98a9bba52ff6 req-dfebed9e-701b-4a46-b749-054a041411be service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:00 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [req-6bf28e45-2706-41a1-85e6-98a9bba52ff6 req-dfebed9e-701b-4a46-b749-054a041411be service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.compute.server_external_events [req-6bf28e45-2706-41a1-85e6-98a9bba52ff6 req-dfebed9e-701b-4a46-b749-054a041411be service nova] Creating event network-vif-unplugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:55:00 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [req-6bf28e45-2706-41a1-85e6-98a9bba52ff6 req-dfebed9e-701b-4a46-b749-054a041411be service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029964 Apr 14 04:55:00 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 387/1154] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:55:00 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [req-76a8583f-978d-45bc-85b1-2a7ea0916e7e req-907a1000-cd4f-4cca-b085-317a831e571e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-deleted", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:55:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-76a8583f-978d-45bc-85b1-2a7ea0916e7e req-907a1000-cd4f-4cca-b085-317a831e571e service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-76a8583f-978d-45bc-85b1-2a7ea0916e7e req-907a1000-cd4f-4cca-b085-317a831e571e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:00 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [req-76a8583f-978d-45bc-85b1-2a7ea0916e7e req-907a1000-cd4f-4cca-b085-317a831e571e service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:00 user devstack@n-api.service[61597]: INFO nova.api.openstack.compute.server_external_events [req-76a8583f-978d-45bc-85b1-2a7ea0916e7e req-907a1000-cd4f-4cca-b085-317a831e571e service nova] Creating event network-vif-deleted:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:55:00 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [req-76a8583f-978d-45bc-85b1-2a7ea0916e7e req-907a1000-cd4f-4cca-b085-317a831e571e service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111356 Apr 14 04:55:00 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 386/1155] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:55:00 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:55:02 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [req-7782bc07-ac99-403c-8258-3512beda3c2b req-25beeb66-f322-4f4a-873d-33a69578c857 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "068de634-b290-46ae-b5a2-ef36165cd23b", "name": "network-vif-plugged", "status": "completed", "tag": "2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b"}]} {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:55:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7782bc07-ac99-403c-8258-3512beda3c2b req-25beeb66-f322-4f4a-873d-33a69578c857 service nova] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7782bc07-ac99-403c-8258-3512beda3c2b req-25beeb66-f322-4f4a-873d-33a69578c857 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:02 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [req-7782bc07-ac99-403c-8258-3512beda3c2b req-25beeb66-f322-4f4a-873d-33a69578c857 service nova] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.compute.server_external_events [req-7782bc07-ac99-403c-8258-3512beda3c2b req-25beeb66-f322-4f4a-873d-33a69578c857 service nova] Creating event network-vif-plugged:2cd60678-2bf1-45e0-8ca7-cf8327cc9a5b for instance 068de634-b290-46ae-b5a2-ef36165cd23b on user Apr 14 04:55:02 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [req-7782bc07-ac99-403c-8258-3512beda3c2b req-25beeb66-f322-4f4a-873d-33a69578c857 service nova] 10.0.0.210 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032575 Apr 14 04:55:02 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 383/1156] 10.0.0.210 () {68 vars in 1394 bytes} [Fri Apr 14 04:55:02 2023] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=8 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:50 user devstack@n-api.service[61596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 04:55:50 user devstack@n-api.service[61596]: Fri Apr 14 04:55:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b (ip 10.0.0.210) !!! Apr 14 04:55:50 user devstack@n-api.service[61596]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Apr 14 04:55:50 user devstack@n-api.service[61596]: Fri Apr 14 04:55:50 2023 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b (ip 10.0.0.210) !!! Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] HTTP exception thrown: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Request method failure captured: Apr 14 04:55:50 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b HTTP/1.1 Apr 14 04:55:50 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:55:50 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:55:50 user devstack@n-api.service[61596]: Connection: close Apr 14 04:55:50 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:55:50 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:55:50 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:55:50 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:55:50 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONmVY7u7UHxiRj8u79eXyR6i-yzdJ5tgnlOHHv5T14yGQAspWR8OMT770BJZdj7M7A_NCBPAkSGG7wWmGsEheIPwXyv57YpGn5J0dQ5iJwwOrOL-Iw8KGXkK6awZDXWtHjPcPXaPdCe6DQCup0w59kir5SyqZkdJLIlY_jaVS5eljao Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Project-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}] Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Tenant-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:50 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:50 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:50 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:55:50 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:55:50 user devstack@n-api.service[61596]: X-User-Id: 67d6c699fc524554a6f4983af91d58fc Apr 14 04:55:50 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:50 user devstack@n-api.service[61596]: method: > Apr 14 04:55:50 user devstack@n-api.service[61596]: exception: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:50 user devstack@n-api.service[61596]: action_args: {'id': '068de634-b290-46ae-b5a2-ef36165cd23b'} Apr 14 04:55:50 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:50 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:50 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Returning 404 to user: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:55:50 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-bd1b72b8-a456-4354-b032-ac7dd723a44a tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 404 len: 111 microversion: 2.20 time: 0.041532 Apr 14 04:55:50 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 388/1157] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:55:50 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:55:50 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_api:SELECT=9,nova_api:UPDATE=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:50 user devstack@n-api.service[61597]: DEBUG dbcounter [-] [61597] Writing DB stats nova_cell1:SELECT=19,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=61597) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:50 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-00d48428-3aa6-41b5-bdc2-e4e56f754084 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '.version_select at 0x7f538ab39510>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:55:50 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-00d48428-3aa6-41b5-bdc2-e4e56f754084 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115532707" status: 204 len: 0 microversion: 2.20 time: 0.036571 Apr 14 04:55:50 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 387/1158] 10.0.0.210 () {64 vars in 1339 bytes} [Fri Apr 14 04:55:50 2023] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1115532707 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_api:SELECT=4 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG dbcounter [-] [61595] Writing DB stats nova_cell1:SELECT=8 {{(pid=61595) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] HTTP exception thrown: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Request method failure captured: Apr 14 04:55:54 user devstack@n-api.service[61595]: request: DELETE /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b HTTP/1.1 Apr 14 04:55:54 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:55:54 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:55:54 user devstack@n-api.service[61595]: Connection: close Apr 14 04:55:54 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:55:54 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:55:54 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:55:54 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:55:54 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONmVY7u7UHxiRj8u79eXyR6i-yzdJ5tgnlOHHv5T14yGQAspWR8OMT770BJZdj7M7A_NCBPAkSGG7wWmGsEheIPwXyv57YpGn5J0dQ5iJwwOrOL-Iw8KGXkK6awZDXWtHjPcPXaPdCe6DQCup0w59kir5SyqZkdJLIlY_jaVS5eljao Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Project-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}] Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Tenant-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:54 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:54 user devstack@n-api.service[61595]: X-User: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:54 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:55:54 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:55:54 user devstack@n-api.service[61595]: X-User-Id: 67d6c699fc524554a6f4983af91d58fc Apr 14 04:55:54 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:54 user devstack@n-api.service[61595]: method: > Apr 14 04:55:54 user devstack@n-api.service[61595]: exception: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61595]: action_args: {'id': '068de634-b290-46ae-b5a2-ef36165cd23b'} Apr 14 04:55:54 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Returning 404 to user: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:55:54 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-0d37cd81-6294-460b-9fc0-f19aea569516 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 404 len: 111 microversion: 2.20 time: 0.043836 Apr 14 04:55:54 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 384/1159] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:55:54 2023] DELETE /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR oslo.messaging._drivers.impl_rabbit [-] [c9fe375e-0662-4753-bd9b-6f692b9fe078] AMQP server on 10.0.0.210:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG nova.compute.api [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 068de634-b290-46ae-b5a2-ef36165cd23b] Fetching instance by UUID {{(pid=61596) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG oslo_concurrency.lockutils [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61596) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.wsgi [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] HTTP exception thrown: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Request method failure captured: Apr 14 04:55:54 user devstack@n-api.service[61596]: request: GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b HTTP/1.1 Apr 14 04:55:54 user devstack@n-api.service[61596]: Accept: application/json Apr 14 04:55:54 user devstack@n-api.service[61596]: Accept-Encoding: identity Apr 14 04:55:54 user devstack@n-api.service[61596]: Connection: close Apr 14 04:55:54 user devstack@n-api.service[61596]: Content-Length: 0 Apr 14 04:55:54 user devstack@n-api.service[61596]: Content-Type: application/json Apr 14 04:55:54 user devstack@n-api.service[61596]: Host: 10.0.0.210 Apr 14 04:55:54 user devstack@n-api.service[61596]: Openstack-System-Scope: None Apr 14 04:55:54 user devstack@n-api.service[61596]: User-Agent: python-urllib3/1.26.15 Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Auth-Token: gAAAAABkONmVY7u7UHxiRj8u79eXyR6i-yzdJ5tgnlOHHv5T14yGQAspWR8OMT770BJZdj7M7A_NCBPAkSGG7wWmGsEheIPwXyv57YpGn5J0dQ5iJwwOrOL-Iw8KGXkK6awZDXWtHjPcPXaPdCe6DQCup0w59kir5SyqZkdJLIlY_jaVS5eljao Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Domain-Id: None Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Domain-Name: None Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Identity-Status: Confirmed Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Is-Admin-Project: True Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Project-Domain-Id: default Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Project-Domain-Name: Default Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Project-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Role: member,reader Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Roles: member,reader Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}] Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Tenant-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:54 user devstack@n-api.service[61596]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:54 user devstack@n-api.service[61596]: X-User: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:54 user devstack@n-api.service[61596]: X-User-Domain-Id: default Apr 14 04:55:54 user devstack@n-api.service[61596]: X-User-Domain-Name: Default Apr 14 04:55:54 user devstack@n-api.service[61596]: X-User-Id: 67d6c699fc524554a6f4983af91d58fc Apr 14 04:55:54 user devstack@n-api.service[61596]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:54 user devstack@n-api.service[61596]: method: > Apr 14 04:55:54 user devstack@n-api.service[61596]: exception: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61596]: action_args: {'id': '068de634-b290-46ae-b5a2-ef36165cd23b'} Apr 14 04:55:54 user devstack@n-api.service[61596]: {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. Apr 14 04:55:54 user devstack@n-api.service[61596]: ERROR nova.api.openstack.wsgi Apr 14 04:55:54 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Returning 404 to user: Instance 068de634-b290-46ae-b5a2-ef36165cd23b could not be found. {{(pid=61596) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:55:54 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-af7f4402-d90f-4cf3-aa24-5e4f68e662b2 tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b" status: 404 len: 111 microversion: 2.20 time: 0.031605 Apr 14 04:55:54 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 389/1160] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:55:54 2023] GET /compute/v2.1/servers/068de634-b290-46ae-b5a2-ef36165cd23b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG nova.compute.api [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61597) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG oslo_concurrency.lockutils [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61597) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.wsgi [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] HTTP exception thrown: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Request method failure captured: Apr 14 04:55:57 user devstack@n-api.service[61597]: request: DELETE /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 HTTP/1.1 Apr 14 04:55:57 user devstack@n-api.service[61597]: Accept: application/json Apr 14 04:55:57 user devstack@n-api.service[61597]: Accept-Encoding: identity Apr 14 04:55:57 user devstack@n-api.service[61597]: Connection: close Apr 14 04:55:57 user devstack@n-api.service[61597]: Content-Length: 0 Apr 14 04:55:57 user devstack@n-api.service[61597]: Content-Type: application/json Apr 14 04:55:57 user devstack@n-api.service[61597]: Host: 10.0.0.210 Apr 14 04:55:57 user devstack@n-api.service[61597]: Openstack-System-Scope: None Apr 14 04:55:57 user devstack@n-api.service[61597]: User-Agent: python-urllib3/1.26.15 Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Auth-Token: gAAAAABkONmVY7u7UHxiRj8u79eXyR6i-yzdJ5tgnlOHHv5T14yGQAspWR8OMT770BJZdj7M7A_NCBPAkSGG7wWmGsEheIPwXyv57YpGn5J0dQ5iJwwOrOL-Iw8KGXkK6awZDXWtHjPcPXaPdCe6DQCup0w59kir5SyqZkdJLIlY_jaVS5eljao Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Domain-Id: None Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Domain-Name: None Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Identity-Status: Confirmed Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Is-Admin-Project: True Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Project-Domain-Id: default Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Project-Domain-Name: Default Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Project-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Role: member,reader Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Roles: member,reader Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}] Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Tenant-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:57 user devstack@n-api.service[61597]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:57 user devstack@n-api.service[61597]: X-User: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:57 user devstack@n-api.service[61597]: X-User-Domain-Id: default Apr 14 04:55:57 user devstack@n-api.service[61597]: X-User-Domain-Name: Default Apr 14 04:55:57 user devstack@n-api.service[61597]: X-User-Id: 67d6c699fc524554a6f4983af91d58fc Apr 14 04:55:57 user devstack@n-api.service[61597]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:57 user devstack@n-api.service[61597]: method: > Apr 14 04:55:57 user devstack@n-api.service[61597]: exception: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61597]: action_args: {'id': '77f6bb83-54ab-485e-8943-742f2f576607'} Apr 14 04:55:57 user devstack@n-api.service[61597]: {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1097, in delete Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 891, in _delete Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61597]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Returning 404 to user: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. {{(pid=61597) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:55:57 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-e3e16527-2b09-4e56-aa13-b1cc042cdcba tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "DELETE /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 404 len: 111 microversion: 2.20 time: 0.030025 Apr 14 04:55:57 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 388/1161] 10.0.0.210 () {64 vars in 1357 bytes} [Fri Apr 14 04:55:57 2023] DELETE /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Calling method '>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG nova.compute.api [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] [instance: 77f6bb83-54ab-485e-8943-742f2f576607] Fetching instance by UUID {{(pid=61595) get /opt/stack/nova/nova/compute/api.py:2977}} Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Acquiring lock "e8c7b186-ea85-4588-b70f-eba063098946" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}} Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}} Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG oslo_concurrency.lockutils [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Lock "e8c7b186-ea85-4588-b70f-eba063098946" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=61595) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}} Apr 14 04:55:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] HTTP exception thrown: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Request method failure captured: Apr 14 04:55:57 user devstack@n-api.service[61595]: request: GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 HTTP/1.1 Apr 14 04:55:57 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:55:57 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:55:57 user devstack@n-api.service[61595]: Connection: close Apr 14 04:55:57 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:55:57 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:55:57 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:55:57 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:55:57 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONmVY7u7UHxiRj8u79eXyR6i-yzdJ5tgnlOHHv5T14yGQAspWR8OMT770BJZdj7M7A_NCBPAkSGG7wWmGsEheIPwXyv57YpGn5J0dQ5iJwwOrOL-Iw8KGXkK6awZDXWtHjPcPXaPdCe6DQCup0w59kir5SyqZkdJLIlY_jaVS5eljao Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Openstack-Nova-Api-Version: 2.20 Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Project-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/c10c8cf348e04e44afbaae93a4b60e36"}]}] Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Tenant-Id: c10c8cf348e04e44afbaae93a4b60e36 Apr 14 04:55:57 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2141578557 Apr 14 04:55:57 user devstack@n-api.service[61595]: X-User: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:57 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:55:57 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:55:57 user devstack@n-api.service[61595]: X-User-Id: 67d6c699fc524554a6f4983af91d58fc Apr 14 04:55:57 user devstack@n-api.service[61595]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2141578557-project-member Apr 14 04:55:57 user devstack@n-api.service[61595]: method: > Apr 14 04:55:57 user devstack@n-api.service[61595]: exception: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61595]: action_args: {'id': '77f6bb83-54ab-485e-8943-742f2f576607'} Apr 14 04:55:57 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2980, in get Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2927, in _get_instance Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2884, in _get_instance_from_cell Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = self._get_server( Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. Apr 14 04:55:57 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:55:57 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] Returning 404 to user: Instance 77f6bb83-54ab-485e-8943-742f2f576607 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:55:57 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-ba761c50-6694-4f95-9074-c081aeb9f63f tempest-AttachVolumeShelveTestJSON-2141578557 tempest-AttachVolumeShelveTestJSON-2141578557-project-member] 10.0.0.210 "GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607" status: 404 len: 111 microversion: 2.20 time: 0.028893 Apr 14 04:55:57 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 385/1162] 10.0.0.210 () {64 vars in 1354 bytes} [Fri Apr 14 04:55:57 2023] GET /compute/v2.1/servers/77f6bb83-54ab-485e-8943-742f2f576607 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Apr 14 04:56:02 user devstack@n-api.service[61596]: INFO oslo.messaging._drivers.impl_rabbit [-] [c9fe375e-0662-4753-bd9b-6f692b9fe078] Reconnected to AMQP server on 10.0.0.210:5672 via [amqp] client with port 47574. Apr 14 04:56:02 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-d1352768-1a8e-4100-8205-ca4dd83b711e tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Action: 'create', calling method: .version_select at 0x7f538a941b40>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1743256580", "metadata": {"Type": "work"}}} {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Apr 14 04:56:02 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-d1352768-1a8e-4100-8205-ca4dd83b711e tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.664173 Apr 14 04:56:02 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 390/1163] 10.0.0.210 () {64 vars in 1233 bytes} [Fri Apr 14 04:56:02 2023] POST /compute/v2.1/os-volumes => generated 353 bytes in 666 msecs (HTTP/1.1 200) 10 headers in 447 bytes (1 switches on core 0) Apr 14 04:56:02 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-548f1f04-b7d6-4cb4-bfb6-7c8e93d42749 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538ac7d2d0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:02 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-548f1f04-b7d6-4cb4-bfb6-7c8e93d42749 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 200 len: 353 microversion: 2.1 time: 0.051844 Apr 14 04:56:02 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 389/1164] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:56:02 2023] GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:56:03 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-df4eb0f1-0dba-4407-a76d-591f3a382f6f tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538bc28ca0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:03 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-df4eb0f1-0dba-4407-a76d-591f3a382f6f tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 200 len: 354 microversion: 2.1 time: 0.064923 Apr 14 04:56:03 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 386/1165] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:56:03 2023] GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 354 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:56:03 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-5983ab51-da6d-435d-ad68-2ead35573d22 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538a940e50>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:03 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-5983ab51-da6d-435d-ad68-2ead35573d22 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 200 len: 354 microversion: 2.1 time: 0.086150 Apr 14 04:56:03 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 391/1166] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:56:03 2023] GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 354 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:56:04 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-02753637-3ef7-474f-9f5a-e37db8ea46c6 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538ac7d630>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:04 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-02753637-3ef7-474f-9f5a-e37db8ea46c6 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "DELETE /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 202 len: 0 microversion: 2.1 time: 0.058423 Apr 14 04:56:04 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 390/1167] 10.0.0.210 () {62 vars in 1325 bytes} [Fri Apr 14 04:56:04 2023] DELETE /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 0 bytes in 60 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Apr 14 04:56:04 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-02aa557f-a1a2-4dd4-8b6c-b8c63e54fb20 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538aea4ee0>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:04 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-02aa557f-a1a2-4dd4-8b6c-b8c63e54fb20 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 200 len: 353 microversion: 2.1 time: 0.051824 Apr 14 04:56:04 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 387/1168] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:56:04 2023] GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 353 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:56:05 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_api:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:05 user devstack@n-api.service[61596]: DEBUG dbcounter [-] [61596] Writing DB stats nova_cell1:SELECT=4 {{(pid=61596) stat_writer /usr/local/lib/python3.10/dist-packages/dbcounter.py:117}} Apr 14 04:56:05 user devstack@n-api.service[61596]: DEBUG nova.api.openstack.wsgi [None req-4d957c7d-6aec-41fb-b4fe-45dce4f79e24 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538a97a7a0>' {{(pid=61596) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:05 user devstack@n-api.service[61596]: INFO nova.api.openstack.requestlog [None req-4d957c7d-6aec-41fb-b4fe-45dce4f79e24 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 200 len: 353 microversion: 2.1 time: 0.086184 Apr 14 04:56:05 user devstack@n-api.service[61596]: [pid: 61596|app: 0|req: 392/1169] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:56:05 2023] GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 353 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:56:06 user devstack@n-api.service[61597]: DEBUG nova.api.openstack.wsgi [None req-a6e225bc-965f-4a8d-ae06-03a20cfc49b4 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538af1f6d0>' {{(pid=61597) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:06 user devstack@n-api.service[61597]: INFO nova.api.openstack.requestlog [None req-a6e225bc-965f-4a8d-ae06-03a20cfc49b4 tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 200 len: 353 microversion: 2.1 time: 0.057152 Apr 14 04:56:06 user devstack@n-api.service[61597]: [pid: 61597|app: 0|req: 391/1170] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:56:06 2023] GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Apr 14 04:56:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1700b549-b322-4a0e-989d-ec19d228b06d tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Calling method '.version_select at 0x7f538ac1c940>' {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Apr 14 04:56:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.wsgi [None req-1700b549-b322-4a0e-989d-ec19d228b06d tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] HTTP exception thrown: Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 could not be found. Apr 14 04:56:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1700b549-b322-4a0e-989d-ec19d228b06d tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Request method failure captured: Apr 14 04:56:07 user devstack@n-api.service[61595]: request: GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 HTTP/1.1 Apr 14 04:56:07 user devstack@n-api.service[61595]: Accept: application/json Apr 14 04:56:07 user devstack@n-api.service[61595]: Accept-Encoding: identity Apr 14 04:56:07 user devstack@n-api.service[61595]: Connection: close Apr 14 04:56:07 user devstack@n-api.service[61595]: Content-Length: 0 Apr 14 04:56:07 user devstack@n-api.service[61595]: Content-Type: application/json Apr 14 04:56:07 user devstack@n-api.service[61595]: Host: 10.0.0.210 Apr 14 04:56:07 user devstack@n-api.service[61595]: Openstack-System-Scope: None Apr 14 04:56:07 user devstack@n-api.service[61595]: User-Agent: python-urllib3/1.26.15 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Auth-Token: gAAAAABkONziYKskvoPpRCzJPDoyo4Owf2owY0CoK8HzgeNgqerS1xcq2SQnL_g4JwiUZbeKWBQcEkDm-gLDZ57UD52PfZkUc3G9VzWqqSzDAb7zNSKpGpODU-MRodQd7MfrilODtE9MosBrx-Svcn05q75y5DJmmRU9NP2Qh69fLu3Ijp8eCh4 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Domain-Id: None Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Domain-Name: None Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Identity-Status: Confirmed Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Is-Admin-Project: True Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Project-Domain-Id: default Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Project-Domain-Name: Default Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Project-Id: 598efa797f02484d92b460673ddf0ac4 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Project-Name: tempest-VolumesGetTestJSON-1983539857 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Role: member,reader Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Roles: member,reader Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2/598efa797f02484d92b460673ddf0ac4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/598efa797f02484d92b460673ddf0ac4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210:9696/networking"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/placement"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.0.0.210/volume/v3/598efa797f02484d92b460673ddf0ac4"}]}] Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Tenant: tempest-VolumesGetTestJSON-1983539857 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Tenant-Id: 598efa797f02484d92b460673ddf0ac4 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-Tenant-Name: tempest-VolumesGetTestJSON-1983539857 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-User: tempest-VolumesGetTestJSON-1983539857-project-member Apr 14 04:56:07 user devstack@n-api.service[61595]: X-User-Domain-Id: default Apr 14 04:56:07 user devstack@n-api.service[61595]: X-User-Domain-Name: Default Apr 14 04:56:07 user devstack@n-api.service[61595]: X-User-Id: 11e0b5056b5747f38743ce230e316a60 Apr 14 04:56:07 user devstack@n-api.service[61595]: X-User-Name: tempest-VolumesGetTestJSON-1983539857-project-member Apr 14 04:56:07 user devstack@n-api.service[61595]: method: Apr 14 04:56:07 user devstack@n-api.service[61595]: exception: Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 could not be found. Apr 14 04:56:07 user devstack@n-api.service[61595]: action_args: {'id': '80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754'} Apr 14 04:56:07 user devstack@n-api.service[61595]: {{(pid=61595) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 could not be found. (HTTP 404) (Request-ID: req-a9f72847-3e8b-4b11-8d61-65e0653e0521) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 503, in get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi context, microversion=microversion).volumes.get(volume_id) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/base.py", line 297, in _get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 220, in get Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 211, in _cs_request Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.10/dist-packages/cinderclient/client.py", line 197, in request Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 could not be found. Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 could not be found. Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 538, in _process_stack Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi with ResourceExceptionHandler(): Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 could not be found. Apr 14 04:56:07 user devstack@n-api.service[61595]: ERROR nova.api.openstack.wsgi Apr 14 04:56:07 user devstack@n-api.service[61595]: DEBUG nova.api.openstack.wsgi [None req-1700b549-b322-4a0e-989d-ec19d228b06d tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] Returning 404 to user: Volume 80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 could not be found. {{(pid=61595) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Apr 14 04:56:07 user devstack@n-api.service[61595]: INFO nova.api.openstack.requestlog [None req-1700b549-b322-4a0e-989d-ec19d228b06d tempest-VolumesGetTestJSON-1983539857 tempest-VolumesGetTestJSON-1983539857-project-member] 10.0.0.210 "GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754" status: 404 len: 109 microversion: 2.1 time: 0.042549 Apr 14 04:56:07 user devstack@n-api.service[61595]: [pid: 61595|app: 0|req: 388/1171] 10.0.0.210 () {62 vars in 1322 bytes} [Fri Apr 14 04:56:07 2023] GET /compute/v2.1/os-volumes/80b3fb8e-6ca3-49cf-a3ec-47b8d1eec754 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0)